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and apply scientific procedures and methods in 
daily life? Cdn students analyze the impact of 
technology on both the environment and man's 
cultural values? 
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of work? 
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job finding, job application, on-the-job negotiation and 
daily work interactions? Have they developed entry 
level work skills when appropriate? 
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L INTRODUCTION * 



Purposes of This Report 

This FY 74 final evaluation report has been prepared in compliance with 
reporting requirements of the Career Education Program staff of the 
National Institute of Education (NIE). As a year-end report it may also 
se^ve two additional^ audiences • First, the (CE)2* operations staff may 
find portions of this"' i*eport helpful in improving project operations and for 
sharing program results with the maixy visitors they receive at the (CE)2 
site. And second, the summary and recommendations from this report 
may be of interest to a general audience of local educators, Tigard School 
Board members, the (CE)2^Board of Directors, community members, 
interested visitors and potential adopters of this prograrn.. 

Contents of This Report ** 

Section I--"Introduction"--contains a statement of the purposes and audiences 
for this report, an e;q)lanation of the report contents, an overview of the 
formative and of the summative*** evaluation design, a brief description^^ 
of (CE)2 and a summary of FY 74 qyaluation activities. The various 

* (CE)2 is the symbol used to represent Community Experiences for 
Career Education, Inc. , the subcontractor holding operational and 
design responsibilities for the program under the auspices of / 
Northwest Regional Educational Laboratory (NWREL). '"—^ 

** This report was prepared by NWREL EBCE project evaluation team 
members Tom Ow^ns, Marshall Herron\(who worked on a full-time 
basis until March 1974 and on a consult^t basis thereafter) and 
Harry Fehrenbacher; it was typed by Kathy Petersen. Mike Hiscox, 
Susan Hiscox, I<arl White and Bill Quinn assisted the team for short 
periods of time in test design and administration, data processing and 
analysis, and/or report writing. Maggie Burton and Nancy Anderson , 
of the EBCE product development unit provided valuable assistance in 
the editing of this report. Special thanks is also given to the (CE)2 
project staff and to Joe Haenn, Dean Nafziger, Bob «Silverfhan and 
^Blaine Worthen of NWREL for their careful critique of the first draft 
of this report. 

*** Formative evaluation examines how well the program is operating, 

identifies program strengths and weaknesses and provides information 
for improving the program. Summative evaluation involves an 
assessment of what students have gained from being in the program 
and how well the program has accomplished its objectives. 



student populations and samples used in this evaluation are discussed in 
some detail in Section H— '^St.udent Populations''~to form a foundation for 
the reader's understanding of comparative test results summarized in 
Section Ill—^'Summative Evaluation Findings,^^ Designs used in the formative 
evaluation of this program vary considerably depending upon the nature of 
the particular formative evaluation question being addressed. Consequently, 
the formative evaluation designs, procedures and results are organized in 
Section IV~'Tormative Evaluation Findings "—around a series of formative 
evaluation questions. The major findings and recommendations of the 
evaluation unit are summarized in Section V— "Summary and Recommendations, 
Finally a set of appendices containing questionnaire tabulations and other 
support data is included to provide more detailed information for persons 
desiring such details. Of particular interest .to some readers are the 
appendices describing the evaluation instruments used, containing the 
independent educational auditor's report of the NWREL evaluation, listing 
the actual skills gain by (CE)2 students, illustrating in detail the 
experiences of two (CE)2 students through the use of case studies and 
summarizing the separate interpretation of these evaluation findings by the 
(CE)2 operations staff. 

A detailed table of contents is provided to allow the reader to more quickly 
locate sections of special interest, ^ ^ 

Cost data are not included as a part of this evaluation report but will be 
handled through a separate study being done by a subcontractor to the 
project. This comparative cost study is due to be completed- by the end of 
1974, ^ \ 

Overview of Summativ e Evaluation Design 

The summative evaluation design was developed to assess effects of the 
(CE)2 program upon its students. For each of the program's student ' * 
^learning outcome goals, evaluators and project staff described a rationale, 
a set of related primary and secondary learning processes and a set of 
progress indicators. The evaluators then determined how each outcome 
goal could best be demonstrated—either by using internal project criteria 
or by comparisons made with external groups. Specifics of those 
arrangements, along with the outcome goals, were displayed in an attachment 
to the FY 74 Operating Plan entitled "Consolidated Formative and Summative 
Evaluation Plan,"* 



* "Consolidated Formative and Summative Evaluation Plan," FY 74 
Operating Plan for the Employer-Based Career Education Program , 
NWREL, Portiand, Oregon: 1973, 



Internal Comparisons , Many evaluative judgments about the Experience -Based 
Career Education (EBCE) program have been made without the use of 
external comparison groups. For example, the program's first year of 
experience provided data for establishing realistic second-year expectations. 
These second-year expectations included a criterion that students would 
complete on the average a greater number of competencies than were 
completed by students during the first developmental year. Similarly, to 
see if their attendance has improved, (CE)2 students' records have been 
xjompared with high school records the year prior to their entjry into the 
program. Other internal comparisons of student. progress have been made 
through a systematic recording of student behaviors by staff members through 
weekly ^'student staffing'' meetings and analysis of questionnaire responses 
in which students, staff, parents and employer instructors assess student 
outcomes and program operations. And, since the program is individualized, 
some evaluative judgments about a given program strategy have been made 
by examining the number of students electing to use that strategy. 

External Comparisons . Use of external comparison groups provides an 
important additional dimension to the evaluation of program objectives. 
Several comparison groups have be^n used.* They include: 

1. Three random samples of Tigard High School students (THS^, THS2> 

THSg) 

• 

2. Students in the Diversified Occupations Cluster of the Tigard High 
School Cooperative Work Experience Program (CWE) 

3. A random sample of students from the Owen Sabin Occupational 
Skills Center (OSC) located in the North Clackamas School District 
southeast of Portland / " 

4. The "true control" group--those students at THS who originally 
volunteered for (CE)2 but who were randomly selected not to 
participate. 

For some program objecMeSTttris appropriate to compare (CE)2 and 
comparison group performance. However, the nature of the external 
comparison groups must be appropriate to the program evaluation to be 
made. For example, a comprehensive evaluation cannot be made solely on 
the basis of whether (CE)2 students demonstrate greater gains in knowledge, 
skills and attitudes than "true control" group students. Evaluators must 
also examine how the growth in career knowledge and attitudes made by 
(CE)2 students compares with that of similar students who volunteer for 
specific school-based career education programs. 



* For a detailed description of the various groups, refer to Section H, 
"Student Populations." 
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Further, examination of baseline and growth data for a random sample of 
students from the-^same grade level of th'e school from which (CE)2 students 
volunteer reveals how experimencal and control groi?)s are similar or 
different from the total student population. This information is essential 
for determining the (CE)2 program's breadth of appeal and for assessing 
the perceptions created by the program's recruiting process* 

Growth data from the random sample group also indicate gains being made 
by a cross section of students from Tigard High SchooL Since the make-up 
of the groups is likely to be different (as was demonstrated In the "FY 74 
First Quarterly Evaluation Summary"*), it may be inappropriate to compare 
such information with growth data for the experimental group* However, 
data on the THS random sample groups give a potential adopter of EBCE a 
base for comparing his or her local schools with those from which the 
experimental group students come* 

Similarly, in cases where no growth data are available from publishers for 
evaluation instruments—as is th^ case with the Career Maturity Inventory 
and the Psychosocial Maturity Scale — growth data on students in one or 
more relevant comparison groups are essential* Use of multiple comparison 
groups will provide evi'dencq as to whether the two instruments are sensitive 
enough to register change over an eight month period for anj; of the groups. 

In summary, questions related to external comparisons go further than 
simply comparing the EBCE results with those of a "true control" group 
made up of program voluflteers who were randomly assigned not to participate 
in the program* Comparisons with other career education programs and with 
a random sample of students from regular high school(s) also provide 
important data* 

Changes Made in the Initial Design * Dr. Kenneth Hopkins, Director of the 
Laboratory of Educational Research at the University of Colorado, reviewed 
the summative evaluation design in October 1973* He pointed out several 
shortcomings in the comparative testing plan which led NWHEL evaluators 
to decide that a posttesting of THS random sample juniors in May was 
essential to obtain a valid measure of student growth in Basic Skills* 

With respect to the affective and career awareness outcome measures, 
experience at another EBCE site last year indicated that attitude changes 
may occur early in the year, then level off or even regress slightly toward 
the end of the year* This potential for attitude changes combined with 
concern about student testing time convinced the evaluation staff to retest 
half of the e^qDerimental and comparison group students in February and half 
in May. 



* FY 74 First Quarterly Evaluation Summary of the NWREL Experience- 
Based Career Education Program , NWREL, Portland, Oregon: 1973. 

» 
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The use of the *'true cohtror* group had to be abandoned since the number 
of such Tigard High School students who volunteered for (CE)2 in the 
spring of 1972 but were randomly selected not to participate in FY 73 
had dropped to three by February 1974. (See Section II, ''Student Populations. 
No FY 74 control group (spring 1973 volunteers) was available. 

Description of (CE) ^ . ^ 

An evaluation report of an alternative program must presume the reader's 
familiarity with certain aspects of that program. However, some preliminary 
description of student activities is called for to help the reader understand 
the evaluation design and findings. During FY 74 (CE)2 involved 50 juniors 
and seniors from Tigard High School on a full-day basis. Students spent 
approximately half of their time at a learning center located in a one-story 
professional office complex next to King City; the other half of their time 
was spent at various employer and community sites. The (CE)2 program 
was in its second year of operation with funds provided by the National 
Institute of Education. A short des -jription of (CE)2 in terms of student^ 
graduation requirements follows.* ^ 

"\ 

Upon meeting the following requirements, (CE)2 students are granted a 
Tigard High School diploma. ^ 

1. Projects . Ten per program year, two in each Life Skills area. Each 
project includes Basic Skills activities. 

2. Competencies . Ond-half of the con^etencies must be completed each 
program year. 

3. Career Explorations . Minimum of five per program year. 

4. Learning Level Plaoements . Two'-thirds of the program year on 
successful learning level experience. 



5, Waiver Clause . Any of the above requirements may be modified or 
waived upon the written recommendation of the project director and 
approval by the Board of Directors. 

To remain in the (CE)2 program^ students were also expected to adhere to 
an accountability' system encompassing general program expectations for their 
conduch** v 

"* For a more complete descjfiption of the program, the reader is referred 
to a general information brochure called, "Community Experiences for 
Career Education," avaiJable free upon request from the Northwest Eegional 
Educational Laboratory. 

** For a discussion of this Student Accountability System, see Section IV, 
page 78. - 
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Many other activities-deluding interacting with the Career Information 
System, working with a tutor and taking formal courses at Tigard High 
School— were among the options available to each student in the completion 
of his or her program work. 

The prior description of activities cannot adequately represent the scope of 
the (CE)2 program. It is hoped, however, that it will define (CE)2 
sufficiently to make this report meaningful- A comprehensive description 
of all (C-E)2 program components will be prepared later this year.* 

A brief comparative description of the purposes, curricula, learning 
resources and student selection procedures for (CE)2 and the two con^arison 
groups (the Diversified Occupations section of the Cooperative Work Experience 
Program at Tigard High School and the Owen Sabin Occupational Skills Center 
in Milwaukie, Oregon) is contained in Appendix O for the reader desiring a 
furtlier understanding of the comparison groups. 

Summary of ^Evaluation Activities , 

FY 73 Summer Tasks . In preparation for the second operational year, 
evaluation staff worked during the summer of m73 with project management 
and (CE)2 operations per3onnel to specify project ^objectives, clarify 
strategics for moving students toward their learning goals and develop 
evaluation procedures for assessing their progress. At the same time, 
NWREL evaluators and (CE)2 staff drafted and prioritized formative ^ 
evaluation questions and established a system whereby new questions could ^ 
be added during the year whenever appropriate. Considerable time was also 
spent identifying important student groups against which (CE)2 student growth 
could be compared. 

Evaluation Instruments Developed . A number of instruments were developed 
for use this year in evaluating the (CE)2 program. Some (student, parent, 
employer and visitor questionnaires) were designed in cooperation with the 
other three regional educational laboratories engaged in EBCE projects. 
Others (student application record, semantic differential, oral communication 
measure and objective-referenced newspaper reading exercise) were 
developed locally. Evaluators also worlced with (CE)2 staff and an outside 
consultant to institute "student staffing, a process whereby staff members, 
on a weekly basis, systematically discuss student behaviors, recommend 
staff interventions and record resultant student affective growth. 

Three instruments developed and tested by researchers outside the EBCE 
program were also utiHzed: the Career Maturity Inventory (CM), Jhe 

* A list of ^Tiandbook" titles and a brief description of their contents is 
. contained in Appendix Q. 
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Psychosocial Maturity Scale (PSM), and the Comprehensive Test of Basic 
Skills (CTBS). Data and information concerning the PSM were exchanged 
with the instrument's developers, Br^ Ellen Greenberger and her associates 
at Johns Hopkins University. The u^e and validity of the CMI for EBCE 
program evaluation was studied jointly by NjWREL and the other three 
laboratories involved with EBCE. ' 

Testing and Follow-Up Activities > Evaluatiqp stai^ planned and administered 

* pre-, midyear and posttests to (CE)2 and comparison group students from , 
Tiga^d High School and the Occupational Skills Center in Milwaukie, In the 
latter case, use of a special research design provided OSC with meaningful 
information on students in each of its ten cluster groups while also providing 
the EBCE evaluators with important comparison group information. Following 
analysis' of the pretests, feedback sessions were held with staff and 
administrators of experimental and comparison group schools so that' they 
could use the res^ilts. THS comparison group students were given individual 
interpretations of their pre- and posttest data, with emphasis on results 
from the CTBS battery. 

Use of an Independent ^ucational Auditor . A work agreement to pilot test 
the use of an independent educational auditor was developed in cooperation 
with Ms. Mary Ann Millsap, NIE evaluation coordinator for EBCE projects. 
Arrangements were made for Ms. Millsap to select an auditor- who would 
independently assess for NIE the techniques and results of the NWREL 
EBCE evaluation. This auditor has certified the accuracy 'of midyear and 
end-of-year testing, scoring, data processing and reporting and will offer 
an independent judgment regarding the interpretations of data that appear 
in this report. It is expjected that the independent judgment of a competent 
auditor from outside the. project will strengthen the credibility cf the EBCE 

* project evaluation unit' ^ findings. (See Appendix B for. a copy of the 
Procedural Audit Report.) 

Adversary Hearings . As ^part of the replication effort, NWEEL hopes to 
provide potential adopters \vith balanced factual data regarding the program 
by using a concept newly adopted in the field of education — the adversary 
hearing. An adversary hearing is simply the legal term applied to common 
trial proceedings in which two sides holding opposite viewpoints argue for 
and against a given proposition, in this case, ^'Should the EBCE program be 
adopted?'' An actual adversary hearing was planned, conducted and the 
proceedings videotaped in July. Potential adopters will view the videotape 
and use the information presented as input in making a decision ort^ ^whether 
or not to continue planning for the possible adoption of EBCE in their local 
communities. The July one-hour videotape is considered a pilot version 
and a more intense hearing is tentatively scheduled to be videotaped in the 
winter, making use of the, experience gained from the pilot tape. In short, 
it is anticipated that the adversi^ry hearing process will serve as an 
alternative evaluation model that places importance upon carefully solicited 



ERLC 



I 



human testimony, the presentation of opposing viewpoints and the critical 
cross examination of witnesses and other evidence presented. Such an 
approach shoidd serve as a useful balance to the traditional evaluation made 
of d^ta collection and reporting. 

Replication Assistance . Members of the evaluation unit have participated 
actively this year in the plaiming and implementing of several conferences 
for potential adopters of EBCE. Feedback questionnaires have been 
developed and analyzed for such conferences as well as for slide and tape 
presentations made by the EBCE replication unit at various school districts 
in the Pacific Northwest. ' 
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11. STUDENT POPULATIONS 



Described in Section II are the various student populations sampled in the 
evaluation activities and comparative baseline dat^ collected from these 
samples. 

The FY 74 evaluation design called for the administration of evaluation 
instruments to students in five critical comparison groups and the (CE)2 
experimental group. Four of the comparison groups are composed of 
students from Tigard High School, the "home base*' of students in the (CE)2 
program; the fifth group is composed of students from the Occupational 
Skills Center program of the North Clackamas School District, 

Comparison Groups 

Occupational Skilis Center ^Comparison Group , North Clackamas School 
District, a neighboring district to Tigard School District, is located in the 
southeast suburbs of Portland, Somewhat larger than the Tigard School 
District, it contains three high schools, four junior high schools and 
nineteen elementary schools. THe district serves a total of approximately 
14,500 students as compared to about 5, 000 ^students in Tigard schools. 
Six years ago North Clackamas School District created a new institution 
called the Occupational Skills Center, The programs at OSC were 
organized into ten occupationaP^'clusters" (construction, marketing, industrial 
mechanics, etc). Students from the district's three high schools electing 
to attend OSC spend one-half day at their ^TDase'' high school and one-half 
'day at OSC* 

The OSC program was considered by evaluators as a useful source of 
students for a comparison group since (1) the large number of students a,t 
OSC (about 800) makes the use of random selection procedures appropriate; 
(2) the program is career oriented; and (3) the OSC program is new enough 
that program administrators were interested in cooperating with NWREL 
evaluators in exchange for evaluation feedback data on their own program. 

Using a table of random numbers, evaluators chose five juniors and five 
seniors from each of the ten occupational clusters. All 100 students were 
pretested in the fall. Using the same stratified random sample roughly 
half were tested again at midyear and the remaining students in May. 

Tigard High School Cooperative. Work Experience Group , The TII^'' 
Cooperative Work Experience program draws its students from the same 

* For a furtlier description of the students and curriculum involved in the 
various comparison groups, the reader is referred to Appendix 0. 

c a 



''poor* as (CE)2. The 25 students referred to in this report as the 
Cooperative Work Experience group are limited those from a Diversified 
Occupations Cluster vvithin the CWE program. This cluster most closely 
matched the variety of occupational interests of (CE)2 students. Other 
clusters within CWE such as business and office management were not a 
part of our comparative testing. Data from the demographic questionnaire 
and judgments of THS teachers and counselors indicate that students from 
this CWE Diversified Occupations Cluster group are more like students who^ 
volunteered for (CE)2 than those from any other comparison group. In 
fact, several of the original volunteers to. (CE)2 have been or are presently 
enrolled in this program. - 

Tigard High School JRandom Samples . Three random samples of Tigard 
High School students enrolled in the regular program were drawn for 
testing this year. These students provided baseline data representing 
stucjents who received no formal career-related instruction. The first 
random sample of 40 juniors and 40 seniors (THSj^) provided comparison 
data on the Career Maturity Inventory and the Psychosocial Maturity Scale . 
The second random sample, of 40 juniors and 40 seniors (THS2) provided 
comparison data on the Comprehensive Test of Basic Skills . One-half of 
the THSi group was retested at midyear and the other half in May. The 
THS2 retest occurred onjy in May. A third group, THS3, was drawn, 
randomly at midyear to help compensate for attrition in the THS2 group 
and to allow the evaluators to check the test-retest effects of the affective 
instruments used. The THS3 group was administered the CMI and the PSM 
for the first time in February and was retested in May. 

Original Volunteer (or "True Control!') Group . At the time of original 
recruitment efforts in spring 1972, roughly 100 students indicated an 
interest in the {CE)2 program. Half of these students, chosen by taking 
every other name from an alphabetized list, were invited to undergo further 
selection procedures such as interviews, meetings with parents and staff, 
etc. By this quasi-random procedure, half were eliminated from consideration 
as potential (CE)2 participants. It is of particular interest to note ^hat has 
happened to students in this group. Of the 47 students whose names were 
recorded, 19 were juniors when they volunteered. All of these 19 juniors 
graduated in the class of 1973. The control group students remaining this 
year appear less academically motivated than those who graduated last 
June. Five of these 28 students reapplied and were admitted to (CE)2 this 
year. Of the remaining 23 students only 8 are still enrolled in Tigard High 
School. The majority either dropped out or were expelled from Tigard 
High School. Of the eight students still in Tigard High, three are in the 
Cooperative Work Experience program and were tested there. Two refused 
to take the tests, leaving only three '^nontreatmenf' students available for 
comparisons. These three students took the CMI and PSM along with the 
Tigard High School random sample group. For all practical purposes, the 
small number of students makes comparisons unreliable and therefore no 
"true control*' data are included in this report. 



(CE)2 Experimental Group . The (CE)2 program started the school year with 
50 students, 48 percent of whom we;De boys. Nineteen of the students were 
juniors newly recruited for this school year. Of the 31 students who were 
seniors, 21 were new to the program. Eleven students left the program 
between October 1, 1973 and January 31, 1974. (Their reasons for leaving 
the program are listed in the Project Director Questionnaire, Appendix F.) 
New students are added to the program as others leave, maintaining an 
approximate total of 50 students at any given time. Between February 1 
and the end of the school year eight additional students left the program. 
One of these students had been in the program only sinc§ midyear. 

Rationale for the Comparisorf Group Testing Design 

A. number of comparisons are made in this report between (CE)2 students 
and those in various comparison groups described above. Decisions 
regarding which groups were to be compared on which instruments were 
based upon the nature of the students in each group, the need for midyear 
as well as -end-of-year data and the limitations on available testing time 
for any%ne group. The number of applicants for (CE)2 in the spring of 
1973 was too low to allow for a random assignment of applicants to the 
experimental or control group. Because the CTBS batteiy required over 
three hours time per administration, it was decided to" draw two random 
samples of students from THS. Group 1 took all of the comparative 
instruments except the CTBS as a pretest while Group 2 took only the 
CTBS. Group 2 was the only comparative group tested with the CTBS 
because the evaluators wished to examine the question of whether (CE)2 
students, by being in the program), lost ground in Basic Skills as compared 
with students remaining at THS. The need for "hard" evaluation data prior 
to the end of the school year caused the , evaluation unit to rely heavily upon 
the use of midyear data. Because the evaluators felt the importance of 
having some data at both mid and end of year, they decided to randomly 
sample (CE)2 and each compai-ison group and to administer some instruments 
to one -half of each group at midyear and other instruments to the second 
half of each group. Since the mid- and end-of-year periods were only three 
months apart, none of the students were tested at both times. Thus the 
half of each group tested on a few instruments in February received other 
instruments in May as a posttest. Since the CWE group involved only 
25 students available for pretesting, an attempt was made "to test all of them 
at midyear and thus ignore them at the end of the year except for a single 
questionnaire given to all groups in May. 

Baseline Comparisons of Student Groups 

Student Background Data . Parallel forms of a general information questionnaire 
were given to students in all comparison groups at the beginning of the school 
year. Information derived from questionnaire responses is condensed here 



from the First Quarterly Evaluation Summary of the NWREL Experience- 
Based Career Education Program, submitted to NIE^in December, 1973. 

Several points of interest can be seen in the demographic data. The (CE)2 
students are similar to those from the random 'sample of Tigard High School 
students with respect to previous employment history, number of community 
organizations in which they have participated, number of hobbies listed, 
number of books reported read last year and ethnic background. (CE)2 
students differ from the random sample of Tigard High School students in 
that the (CE)2 students more often reported having had previous job awareness 
training, were more, interested in attending a technical or trade school, less 
Interested in attending college and had fathers with less formal education. 
In comparison with OSC and CWE students, (CE)2 students more frequently 
listed boredom with school as a reason for entering their respective 
programs.* 

A table summarizing the data from this questionnaire may be found in 
Appendix G accompanying ttyls report. 

Comprehensive Test of Basic Skills Data . Baseline comparison of (CE)2 
• students 'with the THSjj sample can also be made from Basic Skills 
assessment data. The pretest means and standard deviations of.(CE)2 
and THS juniors and seniors on the CTBS are shown in Table 1. As can 
be seen, the THS sample scored substantially higher on all subtests. A 
..series of t^ tests comparing intra-class means found the THS scores 
significantly higher than (CE)2 scores in aU comparisons except arithmetic 
K^r the junior g^oup wliere the mean difference was not significant at the .05 
level. 

The same information contained in Table 1 is displayed in a visual way for 
the reader in Figure 1. 



* A chi square for each of these variables was significant at the .01 level. 



Table I 



GROUP MEANS AND STANDARD DEVIATIONS ON THE CTBS 
PRETEST SUBSCORES FOR (CE)2 AND THS2 STUDENTS 



Group 


Subscale . 


Reading 


Language 


Arithmetic ' 


Study Skills 


{CE)2 Seniors 
(N ^ 28) 


X 

S. 


77.9 


555. 
87.0 


.520 
71.5 


584 

96.7 • 


(CE)2 Juniors 
(N = 19) 


X 

s 


574 
79.9 


532 
70.4 


528 
73.1 


-528 
104.5 


Tigard Seniors 
(N = 20) 


X 

s 


G52 
81.1 


624 
. K1.3 


641 
78.0 


669 
73.7 


Tigard Juniors 
(N = 34) 


X 

s 


(M7 
S2.2 


89.2 


575 
88.2 


638 
81.5 



♦ Seoros shown are based upon expanded standard scores where the national mean 
for combined ninth and tenth grade students is GOO and the standard deviation 
is 100. . ' , , 



Sub scores 



Reading 



TUS Jrs 
(CK)2 Srs 
i ns Srs 

(CE)o Jrs 
rns .Irs 



Ariihmctit- 



Skills 




Fij:. U Ornphio display of moan cvpanded standard .<<corefl for (CE)2 i«nd 
TIIS2 students on the CTHS pn-M'Sl HubrtcarfS. 



ERIC 



7.7 



13 



Table 2 displays the number and percentage pf students from (CE)2 and 
/tHS2 falling into various grade equivalency categories for the CTBS total 
\test%c(/re. Twenty-two percent of (CE)2 juniors and 20 percent of the 
(CE)2 seniors scored below the seventh grade level while none of the THS 
juniors or seniors scored below the seventh grade. Although grade 
equ^alent scores are not precise indicators of student performance, they 
are included to facilitate interpretation by the lay reader. No statistical 
aj\alysis has been- done based on gtade equivalent scores. 

Table 



^ / 



DISTRIBUTION OF GRADE EQUIVALENT SCORES FOR (CE)2 AND THS2 
STUDENTS ON JHE CTBS PRETEST TOTAL SCORES - 





Grade 


Group - 




ySquivalent • 


(CE)2 Juniors 


Tigard Juniors 
N % 


(CE)2 Seniors 
N % 


Tigard Seniors 

, N % 




13. Of 






6 25.0 






3 


15.8 




12.0 - 12.9 


1 


5.6 








4 


21.0 




11.0 - 11.9 


2 


11.1 


2 8.3 






6 


31.6 




ICQ - 10._^9 


1 


5.6 


'^2 8.3 


4 


20.0 








9.0 - 9.9 






6 25. 0 


5 


25.0 


] 

2 . 


10.5 




8.0 - 8.9 


5 


21. b 


3 . 12.5 


3 


15.0 


2 


10.5 




7.0 - 7.9 


5 


21. H 


2 8.3 


4 


20.0 




10.5 




6.0 - 6.9 


2 


11. 1 . 




2 


10.0 








5.0 - 5.9 


1 


5.6 




1 


5.0 






* 


^ 4.0 - 4.9 
3.0 - 3.9 
2.0 - 2.9 
Class Mean 


1 


5.6 




1 


5.0 








Grade Equivalent* 


8. 1 




10.7 


8.1 




11.0 





Because the representativeness of the THS2 senior random sample who 
completed the CTBS is questionable, caution should be exercised in comparing 
the THS senior CTBS results with those of the {CE)2 seniors. However, the 
difference in the junior class scores would indicate that (CE)2 students are 
not drawn from the same population (in regard to Basic Skills) as the 
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THS random sampler (These apparent deficiencies in Basic Skills should be 
taken 'into account when evaluating (CE)2 student performanceO 

CMI and PSM Data > Baseline data were also collected on the affective 
domain for (CE)2 and comparison group students. As measured by tlie PSM 
and CMI (Table 3), (CE)2 students scored significantly lower than both THSi 
and OSC on all substantive scales. The Social Desirability Scale is not 
considered a substantive part of the PSM. Students in (CE)2 also scored 
lower than the CWE on three of the CMI competence tests. While this- 
difference might be due to some self-selection factor that caused certain 
students to volunteer for (CE)2, it might also be explained by poor reading 
skills which adversely affect the validity of these measurement instruments. 
The correlations between the-5CAT verbal scores and CMI attitude and PSM 
total scores on pretest data were found to be .31 and .56 respectively. 

Table 3 


PRKTESl* ML-ANS VoW sl'AI.KS OK THK CMI AND PSM* 
VOU STUDENTS JN (CE)2 AND THREE COMPARISON GROUPS 



Scat I' * * 




G;ioup 






(CE)2 


CWE 
(N-26) 


THS 

(N- 50) 


OSC 


CMI Attituck- Scale 




33.6 


35.4 


35.4. 


CMI Knowing Self 


9.7 


13.4 


13.5 


13.1 


CMI Knowing John 
CM! Choosing Job 


n.7 


15.3 


1G.6 


15.8 




12.0 


13.2 


12.9 


CMI I>ook(n^ Ahead 




10.3 


13. G 


12.7 


CM[ What Should Thc-y Do 
I>SM Work** 


7.5 


7.7 


9.7 


10.2 


ir>^a_ _ _ _ 




54.1 


57.7 


I>SM Self noiiancc 


'15. « 




53.0 


54.8 


reM Identity 

I'SM ('oinmiinieation» 




43. h 


57.3 


59.7 


17.7 . 


'M.2 


53. 5 


55.2 


I'SM Hole 


17.2 


•n.« 


53.4 


56.4 


I>SM Trust 


iiij)^ _ ^ _ 


43^3_ 


55.0 


56.3 


PSM Social Commitment 


57.7 


52. tt 


C3;,7_ 


66.2 


1»SM Tolerant e 


ho.G 


5H.2 


73.0 


76.6 


l>SM Change 


53. a 


50. 0 


60.0 


63^4 


I^SM Total 


159. G 


'119.2 


523.4 


558. 1 


1 PSM Social Desirability 




2f>,2 


31.9 


34.0 



> 



•Those meann not grouijod together by the samo line are significantly diffeicnt at the 
.05 level (IXin'an'q Multiple Range Test), t.g. Mj M2 M3 M4 

Means I and 2 urc not significantly different from each other and"mcnns 2, 0 and 4 
are not significantly different fiom each other. Mean I Is to be Interpreted as 
different from means 3 and 4, however, since It Is not underlined by tho same HnO 
which un<lerllii<*t< means 3 nnd 1. 

Soori'j. «howi tor the PSM <cu]v<< arc based upon the original longer version of tho PSM. 
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student Attendance. Attendance data for the 1972-73 school year were 
collected on the students from THS, CWE and (CE)2 -(juniors and new 
seniors who attended THS during the 1972-73 school year). The mean 
number of days absent is displayed in Table 4. >y 

f 

Table 4 ' X 

AVERAGE ^RJMBER OF DAYS SCHOOL ABST^NCE ^ 
FOR THE 1972-73 SCHOOL YEAR FOR 
THS, CVVE AND (c'e)2 STUDENTS 







Mean Days 


Group 


No, of Students 


Absent 


THS 


74 


10.9 


CVVE 


22 


16. 9' 


{CE)2* 


35 


17. 7 



* Juniors and New Seniors 



As can be seen from Table 4, the (CE)2 and CWE students were absent 
* many more days per student than were the students from the random sample 
at Tigard High School. 

Summary . The baseline data indicate that (CE)2 students are more 
vocationally oriented, less interested in school, weaker in Basic Skills, 
have a higher absence rate and score as being less "mature'' on the PSM 
than their counterparts at Tigard High School- 



IIL SUMMATIVE EVALUATION FINDINGS 



Introduction 

This section of the report contains information primarily regarding student 
outcomes and, to a lesser extent, employer-related outcomes. The first 
part of this section reports student outcomes related to program goal 
statements in Basic Skills, Life Skills and Career Development. For ease 
of understanding each program goal has been stated in question form. 
Following the underlined statement of each program goal is a brief 
rationale explaining why that goal is considered important, a discussion of 
(CE)2 learning activities related to that goal and a summary of the relevant 
findings. The second part of this section reports on the evaluation findings 
according to the evaluation instruments developed and used commonly across 
the four EBCE project sites • The third part summarizes evaluation 
, findings organized around the instruments used by (CE)2 but not by, the other 
three EBCE sites. The fourth part of this section contains the results of 
indepth case studies of two (CE)2 students thus giving the reader another 
way of looking at the project's impact. 



The Basic Skills component of the (CE)2 program corresponds roughly to the 
"three R's.'' Included in Basic Skills are reading, mathematics and written 
and oral communication. All (CE)2 stujlents are expected to participate in 
Basic Skills activities. 



Hava students participating in the (CE) o program increased their general 
abilities in the Basic Skills area at least as much as a comparison group 
of students enrolled in the regular school program at Tigard High School 
(as Measured by the Comprehensive Test of Basic Skills, CTBS) ? 

Rationale . Although the (CE)2 program is not designed specifically to teach 
Basic Skills as measured by the CTBS instru;nent because the program is 
to be comprehensive in design, it is important to assure that (CE)2 students 
learn no less in Basic Sldlls than their counterparts in the regular high 
school program. The (CE)2 program can therefore be considered successful 
if (CE)2 students do better than their counterparts in Life Skills and Career 
Development, while doing as well as the others in Basic Skills. 



PROGEAM GOAL OUTCOME FINDINGS 



Basic Skills Outcome Goals 




feneral 
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Related Learning Activities . In the (CE)2 program the community acts as 
the teacher. That is, tlie program feels that most learning skills students 
are normallj expected to learn in the classroom setting can be obtained in 
a more relevant and meaningful way through contact with the real worlds 
In the program, students are given the opportunity to utilize the community' 
as a '^classroom. Students, participate in exploration level and learning 
level experiences at employer jsites where they learn v;hat applied Basic 
Skills are necessary for yarimis occupations of interest to them. Students 
can then match the Basic .SldJls requirements demanded by the job with 
.those that, they possess and thus identify realistically those Basic Skills 
areas in which they may need to improve. Employers are also encouraged 
to identify Basic Skills needs in a particular student. The project staff 
then work cooperatively with the employer instructors in providing any 
needed skills. Basic Skills improvement occurs at employer sites through 
objectives written into students* projects that require them to apply Basic 
Skills in their work environment. Assistance is also provided to students 
through tutors employed b> the project and through selected programmed 
materials. 

Findings . Data from the pre- and postadmihistration of the CTBS revealed 
that: (CE)2 students, although lower in performance at the beginning of the 
school year than the random sample from Tigard Bigh School, gained 
somewhat more than the comparison grot?) in reading, language expression, 
arithmetic and study skills. None of the differences in gains between the 
two groups was statistically significant using an analysis of covariance. 

Reading 

Have (CE) f> students increased their ability to read a wide variety of 
materials with comprehension? Do students have an increased interest in 
reading ? 

Rationale , A young adult participating in today* s society continually 
encounters the need to read. Even the simplest and most essential of 
life's tasks require the ability to read with comprehensionr The greater 
the student's capabilities, tlie less limited he or she will be in pursuing 
careers and other life areas. Everyday reading activities such as keeping 
informed through the newspaper, following information signs at work and 
in public and communicating through the maU point out the importance of 
this skill. In addition, vast amounts of human laiowledge and entertainment 
are accessible only through reading. A student who is interested in broad 
topics available through reading stands an improved chance of becoming a 
well-rounded, capable human being. 

Related Learning Activities , In addition to tlie related activities discussed 
under General Basic Skills, the (CE)2 project staff work closely with the 
students and employer instructors in identifying a wide variety of relevant 
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reading materials associated with different occupations. Thus students 
gain experience through reading materials such as company brochures, 
manuals, forms, parts* lists or periodic als. 

Findings . On the basis of pre- and postadministration of the reading 
subsection of the CTBS, student participants in the (CE)2 program showed 
a statistically significant gain in reading leveL However, the program 
students' gain in tliis area was not statistically different from the gain made 
by the Tigard High School comparison sample • On a Newspaper Eeading 
Exercise designed to assess the applied reading skills of a sample of. (CE)2 
students, statistically significant growth over the year was demonstrated. 

In response to these items on the Student Questionnaire, "Do you enjoy 
reading?'' "This past year approximately how many books did you read?" 
and "Do you read the newspaper?" (CE)2 students did not report a 
significantly increased interest in reading between September and May. 

Mathematics 

Have (CE) 2 students increased their ability in mathematics this year ? 

Rationale . The use of basic mathematics skills is an essential part of 
everyday tasks such as keeping a checkbook, measuring quantities and 
computing income taxes. These tasks demand that the young adult have a 
firm grasp of matheniatical computation methods. 

Related Learning Activities . The (CE)2 student is able to use the community 
to gain mathematics skills in an applied, relevant manner often missing in 
the traditional high school setting. The tasks encountered at the learning 
level site frequently require tlie student to utilize computational ability* 
This strategy forces the student to recognize the value of having 
mathematical sldlls. If his or her ability is lower than that needed to 
perform the task, the student is responsible for upgrading those abilities 
to an adequate level. , This upgrading of mathematics skills is accomplished 
tRrough the use of projects specifically designed to meet the student's needs. 
Independent study and individual tutoring are also available to the student. 

Findings . Pre^ and postadministration of the Arithmetic subsection of the 
CTBS showed program students to have made a statistically significant 
increase in their scores in this area. (CE)2 students on the average 
increased their grade equivalent scores .7 years. This compares to a 
decrease of . 1 grade equivalent shown by the Tigard High School comparison 
group. 



Writing 



Have (CE) 9 students demonstrated an increase in their ability to use 
writing to express ideas and feelings in a clear and correct manner? Have 
they improved their writing in terms of organization, logical development^ 
clarity, sentence structure, grammar, legibility and technical quality ? 

Rationale , The ability to write clearly and correctly is a basic 
prerequisite for many aspects of daily living. 

Related Learning Activities . Some skill in writing is required in almost 
every .career. As such, the community and specifically the employer 
learning level site provides an excellent opportunity for the student to 
develop applied basic writing skills using job requirements ^s the vehicle. 

The student also develops writing talents through work on projects 
specially generated to meet his or her individual needs and through writing 
in the student journal* / • 

Findings . Data from a locally developed Writing Sampl^ did not indicate 
significant growth in this area over the year by (CE)2 students. While 
students increased their scores (from pre- to posttest) slightly on eight of 
the ten subscales, none of the differences was significant. Data also were 
collected from a comparison group of students at Tigard High School but 
because of miscommunication of instructions during the .posttest administration, 
the results could not be validly scored. 

On the Language subtest of the CTBS, (CE)2 students on the average 
increased their score from 50.9 on the pretest to 53.5 on the posttest. 
This difference was not statistically significant. The comparison of change 
on this subtest by (CE)2 students with change by the THS comparison group 
also yielded no significant differences. 

Oral Communications 

Have (CE) 9/ students demonstrated an increased ability to communicate 
verbally in an effective and comfortable manner with employers and other 
adults with whom they associate ? 

Rationale . The ability to communicate orally in a clear and correct manner 
is a prerequisite to functioning adequately in the adult world. Many areas 
of life require the young adult to demonstrate the skills of listening and 
speaking; a person's successful employment and his abilities in j^ocial 
situations are but two examples of major life areas in which oral 
communication plays a vital role in the degree of satisfaction obtainable. 



Related Learning Activities . Unlike the typical high school curriculum the 
(CE)2 learning process places students in constant contact with a wide range 
of adults in the community—each adult holding a different role and 
responsibility. To successfully participate in the program, the student is 
forced to communicate orally with students and adults in both formal and 
informal settings. These experiences serve to, develop the individual's 
verbal skills. Such, development takes place throughout the program, but 
it is particularly apparent in the student^s interaction at employer sites. 
In exploration levels the students are required to interview an employer 
about a job. In learning levels the student Iparns to communicate both 
feelings and ideas with adults. 

Students are also given opportunities throughout the year to talk about (CE)^ 
to groups of visitors. The project's student coordinator has conducted an 
Interpersonal Communications worksliop for students desiring to improve in 
this area. The project staff have recognized the importance of interpersonaJ 
communications and have made this one of four major areas to' monitor in 
students this year in the weekly student staff ings. 

Findings. No direct measures of oral communications ability were utilized 
as part of the evaluation plan this year. Several indirect measures were 
available however. 

On the subscale of the Psychosocial Maturity Scale that deals with attitudes 
toward communication and personal interaction situations, (CE)2 students 
demonstrated significant gains from pretest to posttest.. 

In response to a question on the midyear Student Opinion Survey dealing with 
the learning level site experiences, 69 percent of the students indicated that 
they thought it was now easier to talk with adults (after the e?iprience); 
12 percent indicated that they were not certain of the impact of the experience 
and 19 percent said the experience did not make communicating v/ith adults 
any easier. Ninety-six percent of the students reported that they felt free 
to talk and joke around with people at work. \ 

On the Student Opinion Survey, (CE)2 students Were asked to rank 15 program 
outcomes in order of effectiveness. (CE)2 students ranked the program's 
accomplishments in teaching communication skills as the sixth most 
effective of the outcomes. Parents, staff and employers, using other 
instruments, ranked it as the third most effective aspect of the program. 
A second program outcome, dealing with the improvement of interpersonal 
and social skills, was ranked tenth most effective by the students, ' eighth 
most effective by employers, and sixth and fourth m(ys<^ effective by parents 
and staff respectively. Table 5 ranks these program outcomes according 
to their perceived effectiveness. 



Table 5 

EFFECTIVENESS OF ACCOMPLISHMENT RANKING 
FOR PROGRAM OUTCOMES 



Program Outcomes 
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On another instrument, the student coordinator was asked to rate (CE)2 
students on how well they interacted with others when they entered the 
program and again at the end of the year* A summary of these ratings 
(see Table 6, page 29) indicates that 19 students demonstrated positive 
change in tlieir interaction behavior, 4 demonstrated negative change and 
12 students made no change during the year. 



Life Skills Outcome Go? Us 

The Life Skilly include the attitudes and skills necessary to integrate the 
multiple roles that students will play in their daily lives. The Life Skills 
portion of the (CE)2 curriculum builds awareness and skills in; personal 
and social development, functional citizenship, ^critical thinking, creative 
development and science. Thirteen competencies (survival skills) help 
round out the Life Skills area. 

Critical Thinking ' \ 

Did students increase their ability to gather, analyze and interpret 
Information and to seek solutions to their problems ? 

Rationale , The student ^faces the need to make important decisions many 
times throughout his or her lifetime. The use of critical thinking skills 
enables the student to more often make the most advantageous decision. 

Related Learning Activities , The (CJE)2 program continually forces student 
participants to develop their critical thinking skills through the use of two 
learning projects per year and through explorations on job sites. Tfte 
student is repeatedly confronted with the nee'd to gather data and then use 
it to^ make viable decisions. For critical thinking, as in all Life Skills 
areas, all (CE)2 students are required to engage in activities to improve 
their skills. While an opportunity to do this might be available at the 
regular high school, not all students are required to interact \Yjth all Life 
Skills areas. 

Findings , Student Opinion Survey questions regarding the effectiveness of 
the program in accomplishing s'tudent learning in the area of critical 
thinking were ranked in Table 5, page 22, (CE)2 students tanked the 
program's ability to help students make decisions and follow through as 
fifth in effectiveness out of fifteen program outcomes. On a similar 
instrument the staff ranked it ninth, parents ranked it eleventh, and 
employers twelfth. Students and staff ranked the program^s ability to 
teach students to ''think through and solve problems*' as the seventh most 
effective outcome. Parents ranked it ninth and employers tenth. . 

On the Study Skills section of the Comprehensive Test of Basic Skills , 
which measures the, student's ability to use a variety of resources to solve 
problems, (CE)2 students exhibited a statistically significant positive gain 
over the year, going from 25.3 to 30,2, This gain, however, did not 
differ significantly from that shown by the Tigard High School comparison 
group. 

Students also responded to a semantic differential instrument, one section 
of which measured attitudes toward the term "Decision Making. " In 
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reacting to this term, students exhibited a positive gain in attitude which, 
between pre- and posttesting,- was significant. 



On the Psychosocial' Maturity Scale 54 percent of the (CE)2 students in 
September agreed or strongly agreed with the statement that "in a group 
I prefer to let other people make the decisions. " In May, 46 percent of 
the (CE)2 students agreed or strongly agreed with that statement. 

A total of 85 critical thinking projects was planned by project learning 
managers, this year. Seventy of these projects were completed by the, 
students by June. A summary of the staff's evaluation of student products 
(outcomes resulting from the projects) shows 48 percent of the products 
received positive comments from the learning managers, '37 percent received 
neutral comments and 15 percent .were given minimally acceptable ratings. 
Fifteen projects were left incomplete by students.* 

In addition to the quantitative measures related to student attitudes, an 
attorney, Mr. Norman Sepenuk of Portland, Oregon, was employed as an 
expert consultant to evaluate the design of the critical thinking goals, 
projects and objectives. It was his opinion that the projects were meaningful, 
community-based learning experiences and that they were useful in leading 
students to the outcome goals. His primary suggestion was to examine the 
possibility of having students develop their own projects in the critical 
thinking area. The actual development of the project would force the 
student to encounter critical thinldng opportunities that would not otherwise 
be available. 

Science 

Have students increased their ability to recognize and apply scientific 
procedures and methods in daily life? Can students analyz e the impact of 
technology on both the environment and man's cultural values ? 

Rationale . The existing level of technology in this country has brought 
every person into contact with the influence of science. Understanding 
scientific procedures and the effects of the resultant processes on the 
natural environment and on human values is an essential step toward 
meaningful participation in today's society. 

Related Learning Activities . The (CE)2 program attempts to develop this 
understanding through the use of projects specifically designed to involve 
students in the consideration of some aspect of science. Learning activities 
require the student to actually use scientific processes in exploring both the 
factual background and cultural implications of a subject. The student may 
often utilize the employer site for his investigation; special community 



* Projects begun by students in their junior year may be completed during 
the senior, year. 



resources are also available. The projects are formulated to direct the 
student toward accomplishing the behaviorally-wrilten learning objectives. 

Findings , While the broad nature of the overall outcome goal does not 
allow precise measurement of student achievement, significant evaluation of 
the science Life Skills area can be performed. Mr. Thomas A. Wayne, a 
science professor at Lane Community College, was employed to determine 
the success of the science projects in directing student learning toward the 
outcome goal. His principal conclusion was that completion of the two 
required science projects did indeed lead the student to the desired goal, 
that the project activities relate well to the learning objectives and that 
projects were educationally meaningful. A weakness was pointed out in 
the limited utilization of the Life Skills assessment information in the 
actual preparation of student activities. Specifically, 14 of the 26 projects 
did not contain information about .the results of the Life Skills Assessment 
Test in science. In only two of the projects, was there perceived to be a 
need to increase the project's emphasis on the use of community resources 
as a means of completing the project. 

Most projects were judged by the expert to be highly related to the learning 
objebtives; only five projects did not gain ratings of one or t^vo on a 
five-point scale measuring the degree of relationship between project 
outcomes and learning objectives. However, 8 of the 26 projects did not 
clearly state the learning objectives to be accomplished. In addition, 
almost every project was perceived to demonstrate the features of a 
meaningful learning experience. In summary, Wayne noted, ^'TJiere is the 
strongest indication that the projects as written serve as useful tools to 
lead the student from the learning objective to the outcome goals." 

The science projects varied considerably in their emphasis; some were 
more purely scientific in their orientation (e.g., Basic Anatomy and Its 
Processes, Nuclear Energy) while others were more applitju (e.g., ESP, 
Mysticism and the Occult, The Sewing Machine). A total of 69 science 
projects were planned by students and staff this year. Of this total, 
56 were completed by June. Thirty-one were completed outside of the , 
learning center and 19 of these involved the student's work at an employer 
site. Nineteen percent of the students* completed products were rated as 
minimally acceptable by the learning managers; 56 percent were rated high 
in quality. The remaining 25 percent of the students' work received 
neutral comments from the learning managers. 

Creative Developriierit 

Have students increased their participation in the creative process of 
blending new and/or existing materials, ideas or concepts into unique forms 
and experiences? Can they identify the effects and desirability of these 
creative experiences ? 
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Rationale > Education in the traditional setting often concerns itself 
primarily with a repetition of past facts rather than stressing individuality 
and creativity in the present* Creativity is an essential element of self- 
expression; the development of one's creative abilities is an important step ^ 
in satisfactory overall growth. 

Related Learning Activities , Student learning projects in the (CE)2 program 
are chosen to help direct creative growth. Two projects during the year 
are intended to provide each student with an opportunity to transform one 
of his or her own interegts into a unique and creative learning experience 
that does not perpetuate the often irrelevant methods of the typical 
curriculum. 

Findings , Since creativeness is centered in process rather than in product, 
student achievement related to the outcome goal is difficult to measure. 
However, an extensive evaluation to determine the efficacy of directing 
the student toward the outcome goal was conducted by Mr. Terry Melton, 
Executive Director of the Oregon Arts Commission, His analysis pointed 
out several perceived shortcomings in the creative development projects 
prepared for students. It was his opinion that many of the student projects 
were too preoccupied with styles and techniques rather than processes; 
that many of the projects did not truly lead the student to creative thought 
but instead simply provided the student with an. understanding of sonie craft. 

Each of the 17 student projects (covering such diverse subjects as cartooning, 
maze construction and comparative classical musfc) available at the time of 
the evaluation was rated by the expert in terms of its potential for creative 
''thinking-learning, " Only four of the projects were rated as Having a 
substantia positive potential for getting to the '^creatiye essenses, " Melton ^ 
felt that completipn of the required two projects in this area would lead the 
student to the desired outcome goal only if the two projects performed 
contained this substantial positive potential. It was his opinion that the 
projects showed more general emphasis on action sldlls than on thinking 
skills. 

This consultant thought that the writers of the creative development projects 
perhaps treated creativity much tlie same as instructors in the standard 
high school setting—as something that can be demonstrated more by an 
action, process than a thought process. It was Melton's opinion that this 
priority should be reversed, and that true Creativity is almost totally a 
thought-based accomplishment. It should be noted, however, that 11 of the 
17 projects examined were felt to contain at least some potential for 
directing the sludent toward an understanding of the creative process; this 
percentage is perhaps higher than could be anticipated for ''creative* 
projects*' in the traditional curriculum. In addition, it may be possible for 
students, through their learning projects, to indeed participate in the 
creative process regardless of their degree of understanding of the process 
itself. 
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A total of 67 creative development projects was generated by program . 
learning managers this year. Of tKis number, the staff certified that ^ 

45 were completed successfully by the students. Thirty of the completed 
projects were performed outside of the learning center, but only seven of 
these were comf)leted at employer sites. A summary of learning manager 
comments on the Student Project Evaluation Form indicates the followng: 

46 percent of the creative development projects resulted in positive 
learning manager comments about the quality of the student's product; 
40 percent of the evaluations were neutral; and the remaining 14 percent 
were regarded as minimally acceptable. 

Functional Citizenshi 
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Have students increased their ability to understand democratic processes 
in the loc£\l, state and federal governments and in the private sector ? 
Do they apply those processes in their personal actions as well as in 
, their relationships to private and public institutions ? . t 

Rationale. There is probably little question Ui?t an increased awareness of 
the workings of government and the *respons^^ity of citizenship is highly 
beneficial to both the student and to society. The daily application of 
democratic principles combined with a knowledge of the framework of our 
. governmental system^ can do much toward making the student an effective 
citizen. 

« 

Related Learning Activities , The (CE)2 jprogram attempts, through use of 
carefully designed projects, to place the students into a learning situation 
where their Qwn efforts will leadVthem to discover the role citizenship 
plays in making a \vell-rounded member of the adult world. In addition, 
five of the student competencies relate directly to„ citizenship objectives 
(e.g., "understand the basic structure and function of local, state and 
federal government, ''explain 9ne's own legal rights and responsibilities'')* 
The student accountability system encourages students to be responsible for 
planning their own learning program and coordinating their own day-to-day 
activities. Finally, through the process of student staffing, student progress 
in the area of personal responsibility is monitored and individ^lized 
activities are planned. ^ * 

Findings , Two characteristics of this^L^fe Skills area make evaluation of 
the program's success very difficult. The first, of course, is tiie extremely 
broad nature- of the outcome goal. The second is the difficulty in observing 
student citi^jenship behavior in a realistic setting; that is, much of the 
true growth of program students in the area of functional citizenship 
cannot be determined in an experiment&.l situation. 

An average of 14 students completed each of 'the 5 "citizenship" competencies. 
This compares to an average of 26.students completing the other 8 competencies. 
/ 



Six students pomg^Ieted the competency, ''understand the basic structure and 
function of local, state and federal government," and five students completed 

'It&e competency titled ^"explain one's own legal rights and responsibilities," 
Further discussion on this point is contained under the question dealing with 
competencies on page 30. A total of 69 fimctional citizenship projects were 

^ written by the program staff; 47 of these v^ere Completed by the end of the 
school year. The learning manager ratings of the student products imply 
that these functional citizenship projects were the poorest of any of fiie 
Life Skills project groupings. The same number of products (36 percent) 
were rated as minimally acceptable as were rated positively, while 
28 percent of the' students* work rfe^eived neutral comments. 

Personal-Social Development • 

Have students increased their ability to determine "Who they are," "What 
they are," ahd 'Where they are going?" Do they accept the responsibility 
for the effect that their behaviors and attitudes have on themselves and on 
other people ? 

RationaJti^. Personal management skills, including mental health skills, 
self-analysis, self-direction, and an understanding of responsibility are 
essential to life adjustment. The shident^s personal Vell-being as an adult 
depends in large part on the ability of the educational system to reinforce 
growth in these areas. 

Related Learning Activities . Several' aspects of the (CE)2 instructional 
system are designed to provide direction to the students* pSlfsohal and 
social, development. As in all tlie Life Skille areas, students working in 
this area use projects to help them achieve the designated outcome goal.^ 
In addition, stud^ftfA^ face many of the responsibilities required of mature 
adults when they participate at employer sites. Getting along with coworkers, 
'being on time and having a respect for property are only a few examples 
of the "working world" habits that a (CE)2 student must develop. 

Activities of the student/staff retreats, Wednesday student meetings and 
individual work task negotiations between staff and students also provide 
.an opportunity for the student's personal and saqial improvement. *A 
program accountability system is in operation^ This system helps students 
understand the importance of adhering to established procedures. Rewards 
and penalties are employed to help students beccime more responsible for 
their own behavior. The program's structure also provides each student 
with subtantial opportunities for receiving counseling and guidance from 
staff, employers and community individuals and agencies. 

Findings . On the Psychosocial Maturity Scale (CE)2 students demonstrated 
a statistically significant gain on the Personal Adequacy scale. A gain was 
likewise noted on the Semantic pifferential where students demonstrated a 
' positive change in attitude toWard the concept of "Me. " 



A total of &9 projects were generated in the personal and social , 
development Life Skills area. Fifty-seven of these projects were completed 
by students. Positive ratings were given by the learning managers to^the 
quality of the products from 39 percent of these projects completed; neutral 
ratings wera given to 33 percent; and 28 percent received negative ratings 
(low qualify). 

The student coordinator was asked to rate each of the (CE)2 students on 
four variables (responsibility, cooperation, interactions and enthusiasm) 
when they entered the program and again at the end of the school year. 
A summary of these ratings indicates positive growth by at least 30 percent 
of the students m each -area. The frequency and direction of change in 
each area is summarized in Table 6. As can be seen in Table 6, the 
student coordinator observed growth most frequently in the area of improved 
personal interactions of students with adults and peers. There were also 
some students who were judged as having made negative growth in each area. 

I Table 6 

SUMMARY OF STUDENT CHANGE IN 
RESPONSIBILITY, COOPERATION. INTERACTIONS AND ENTHUSIASM 
AS RATED BY 'THE {CE)2 STUDENT COORDINATOR 



Type of 
Change 


Type of Behavior 


Respoiisibility 


Cooperation 


Interaction 


Enthusiasm ' 


Positive Change 


14* 


15 


19 


11 


Negative Change 


7 


6 




7 


No Change 


14 


u 


12 


17 



* The quantities in the cells represent the number of students exhibiting 
positive, negative or no change. 



Co mpetencies 

Have students demonstrated survival skills that cover the economic, planning , 
legal" political, safety-health, property mainjenance,' recreational and 
occupational aspects of living; i>e>, can students perform behaviors 
considpred by the community to be some of the minimal functional 
requirements for living in today^s society ? 

Rationale . A critical aim of the (CE)2 program is to provide students with 
the opportunity to learn skills considered essential to their survival in the 
adult world. Competencies such as responding to emergencies or holding a 
job are required of mature members of society* Quite often nb segment of 
the traditional high school curriculum will consider theae mandatory Life 
Skills, dwelling instead on more academic but less relevant topics • 
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Related Learning Activities ^ In the (CE)2 program information is made 
available to the students to direct their independent learning of the 
competencies. The student studies until he feels secure in his or her 
ability to perform the task.. An expert in the community is then contacted 
to act as the ^'competency certifier. Students demonstrate their ability to 
' perform the competency to this expert, who, if satisfied, certifies that the 
student does in fact possess the required Life SkilL The 13 (CE)2 program 
competencies are: (1) transact business on a credit basis; (2) maintain a 
checking account in good order; (3) provide adequate insurance for self, 
family and possessions; (4) file state and federal income tax statements; 
(5) budget tiriie and money effectively; (6) maintain the best possible health 
and make appropriate use of leisure time; (7) respond appropriately to 
police, fire and physical health emergencies; (8) participate in the electoral 
process; (9) understand the basic structure of local, state and federal 
government; (10) explain one's own legal rights and responsibilities; 
(11) make appropriate use of public agencies; (12) make application for 
employment and successfully hold^Aob; and (13) operate and maintain an 
autoi^obile. A student is requirecL^^^o complete all of the competencies to 
graduate from the program. 

Findings ^ Table 7 lists the competencies certified for (CE)2 students for 
each month during the school year. The data in Table 7 Indicate that 
work on completing the competencies fluctuated over the course of Ihe 
school year (se6;^luimi totals). The row totals indicate that some 
competencies were ^attained much more often than others. For example, 
transacting business on a credit basis was certified for 94 percent of the 
students, whereas explaining one's legal rights and responsibilities was 
certified for only 10 percent of the students. Competencies 8, 9 and 10 
dealing with functional citizenship were each completed by less than 
20 percent of the students. This was partially due, in the opinion of some 
of the staff, to the fact that these three ^mpetencies were viewed bj^ many 
students as quite complicated and were thus avoided. Revision of the 
competencies in functional citizenship this summer should make them more 
understandable apd interesting to students. *rhe percentage figures in 
Table 7 are based on 50 students although program enrollment varied, due 
to student withdrawals and entrances throughout the year. (Thirty-five of 
the 50 students spent the entire school year at (CE)2. Data from students 
who withdrew from the program before May 1 are not included.) 

A total of 281 competencies were completed by the 50 students this year for 
! an average of 5.6 competencies per student. This compares to 76 completed 

last year by 25 participating students for an average of 3 competencies per 
student. The^ relative popularity of particular competencies has not varied 
substantially from last year. 
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student opinions about the usefulness of the competencies were also collected. 
A sample, of 14 students was in£erviewed in February by the evaluation unit 
and asked to rate the usefulness of various segments of the (CE)2 program 
learning process as either high, medium or low. Six of the students, felt 
the competencies were highly useful in their learning, eight felt that they 
were of medium usefulness. No student interviewed felt the competencies 
were of low ^ usefulness. 



Career Development Outcome Goals 

The Career Development component of (CE)2 has the goal of providing 
students with the opportunity to explore and learn about specific careers 
at actual, job sites, while at the same time enabling them to learn more 
about their own interests and aptitudes and how they fit into the world of 
work. 

Have (CE )9 students increased their knowledge of their own aptitudes , 
interests and abilities and applied this understanding to their potential 
cetreer interests ?' 

Rationale . The (CE)2 project staff consider a mature career choice to be 
one in which a person matches a knowledge of his or her own aptitudes, 
interests and abilities to the characteristics related to a given occupation. 
Such a match requires an adequate knowledge of self. 

Related Learning Activities . {CE)2 students are required during each 
program year to use five diffeVent employer learning sites for exploration 
level experiences. Each exploration level lasts approximately three to 
five days* During and after completing each exploration level, the 
student completes an Exploration Level Package which requires that the 
student obtain career information such as company .policies, nature of 
the work, wor^k environment, qualifications and preparation required, 
earnings and fringe benefits and future employment prospects. The 
exploration level also develops and enhances the student's ability to 
understand his^or her interests,, abilities and skills and to naatch these 
with job. characteristics. 

Other resources used by (CE)2 students to help them better understand 
their own aptitudes,* interests and abilities and their relationship to potential 
careers are the Self -Directed Search and the Career Information System . 
The Self-Directed Search is a self-administered inventory of educational, 
and vocational planning in which the student identifies preferred activities, 
competencies and occupations. The Career Information System , developed 
by the University of Oregon in cooperation with several other agencies, is 
an Interactive computer program that students can access whenever they 
wish on the (CE)2 terminal. This computer system helps the student to 



identify and match certain personal arid job characteristics such as physical 
limitations, preferred location for living and working, education and training 
requirements, aptitudes, interests and job earnings. Information from both 
of these instruments was used to guide students in tlie selection of 
appropriate job exploration sites. 

Findings . Indirect measures of knowledge of self indicate significant 
growth over the year on the Semantic Differential in attitude toward the 
concept of "Me." Significant change was also noted on the Individual 
Adequacy scale of the Psychosocial Maturity Scale> On the midyear 
Student Opinion scale, students ranked the program's ability to help students 
have a more realistic attitude toward thefaiselves as tenth most effective of 
fifteen outcomes. Parents ranked it as the sixth most effective, employers 
fifth, and the (CE)2 staff rtoked it as the most effective aspect of (CE)2 
(see Table 5, page 22). 

On the Student End of Year Questionnaire, (CE)2 students reported their 
year's experiences as more helpful in building their understanding about 
themselves than did any of three other comparison groiq)s of students. 
One a five-point scale, with five being *'very helpful" and one being "of 
little or no help, " (CE)2 students gave an average rating of 4* 2 to this 
item. This compares to a rating of 3.3 by a random sample of Tigard 
High School (THS) students; 3.7 by a sample of students from the 
Occupational Skills Center (OSC); and 2.9 by students in the Diversified 
Occupations Cluster of the Cooperative Work Experience (CWE) Program 
at Tigard High School. To a second question asking how helpful the student' 
(CE)2/school experiences were in helping the student prepare for future 
learning, whether in school or on the job, (CE)2 students rated their 
program as 4.0. THS and CWE students Were somewhat lower (2.9 and 
3.0) and OSC students rated their program at 3.8. 

To the extent that willingness to express a career choice is an index of 
student ability to match self with career opportunities, a Slight increase 
was noted during the course of the year. In the fall, 15 percent of (CE)2 
students indicated they did not know what they would be doing one year 
after graduation. By the end of the yeaXi. JL2_percent indicated that they 
did not have plans for one year after graduation. lt~ should be rememboredj, 
however, that September figures represent all students who completed the 
student information questionnaire then, while the May figures involve a 
number of students who joined (CE)2 during the year and excludes students 
who dropped out of the program throughout the year. Reductions in short 
term career uncertainty were also noted for students in the OSC and CWE 
programs. All of the students in the random sample at THS in September 
expressed a short term career or educational goal while 11 percent of them 
in May indicated uncertainty, about what they would be doing one year after 
graduation. When 1972-73 graduates of {CE)2 were presented the statement 



"(CE)2 helps me decide what I want to do after high school, four agreed 
with the statement and three expi^essed disagreement, * 

On three questions from the Student End of Year Questionnaire that dealt 
with preparation for and knowledge of the steps necessary for entering a 
chosen career (items 9, 10 and 11), (CE)2 students indicated a level of 
preparation and knowledge similar to the comparison groups. Responses 
from (CE.)2 and the comparison groups indicated better career preparation 
than the results from a national sample of 3,000 high school juniors using 
the same question. 

Have (CE )9. students increased their knowledge of social and economic issues 
and trends of the world of work ? 

Rationale , Before a person chooses an appropriate career he or she should 
have adequate knowledge of the world of work as well as knowledge about a 
particular job. 

Related Learning Activities , One of the primary strategies used by (CE)2 
to communicate an understanding of social and economic Issues and trends 
of the world of work is that of employer seminars. In these seminars 
this year employers discussed with students procedures for applying for a 
job, the impact of economics on our lives, the changing work ethic and job 
discrimination, / 

/ 

Knowledge of social and economic: issues and trends was sometimes gained 
by students on an individual basis through explorations and learning level 
experiences, and through student projects. 

Findings,, On both the Semantic Differential and the Psychosocial Maturity 
Scale , (CE)2 students expressed more positive feelings about the concept of 
•Work" at the end of the year than they did in the fall. 

On eleven questions measuring common misconceptions about the world of 
work used in the Student End of Year Questionnaire (items 12-22),^ (CE)2 
students did not score significantly different from any of the thtee comparison 
groups. No pretest data were collected in this area. The scores for (CE)2 
students and the comparison groups were slightly higher than those obtained 
from a national sample of 3, 000 eleventh graders. 

Two questions included on the Student Opinion Scale at midyear dealt directly 
with an understanding of the world of woi^k. In response to a question that 
asked *'In comparison with regular schools, how much opportunity did the 
Career Education Program provide you for learning about occupations?*' 
95 percent of (CE)2 students responded ''More" or "Much More," Five 
percent responded "About the Sanfie* " In response to a second question 
dealing with knowledge about salaries, education and special skills associated 
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with selected occupations, (CE)2 students scored the same as the THS and 
CWE groups • On the Attitude Scale of the Career Maturity Inventory , 
(CE)2 students demonstrated a significant positive change from pretest to 
posttest* This change was not observed among the comparison groups. 

Have (CE) ^ students developed the general skills of job fi nding, job 
application, on-the-job negotiation and daily work interactions? Have they 
developed entry level work skills when appropriate ? 

Rationale , Mastery of gene;ral and specific career skills is essential for 
obtaining and holding a job. Some skills such as being able to use a 
variety of sources to locate available jobs, writing resumes and interviewing 
for a job, and successfully interacting with supervisors and coworkers on a 
job are considered essential for all students and can best be mastered 
--through direct experiences. The development of specialized entry level 
skills for^a potential career^ of the student's choice has not been mandated 
for all students because some have not made a firm choice and others are 
planning to enter jobs requiring postsecondary preparation. 

Related Learning Activities , The (CE)2 project offers students opportunities 
for general and specific job skills through exploration and learning levels; 
employer semin ars, such as the one on job application procedures; student 
« projects taking place at employer sites; and the competency requiring a 
student to make application for employment and successfully hold a job. 

Findings , The most direct measure of the students^ ability in this area is 
the number of students attaining competency number 12, ^^Make Application 
for Employment and Successfully Hold a Job, A total of 28 students, or 
56 percent of thd program^s maximum enrollment, attained this competency 
this year,^ ' . , 

Data provided by participating employers on the Student Performance Review 
indicate that (CE)2 students are developing the skills needed in daily work 
interaction. Employers repoi^t that' students seek feedback on their 
performance, accept criticism and use it constructively, and progressively 
seek less supervision over tjme, 

A review of the student portfolios at the end of the year indicates that a 
wide variety of special skills have been attained by (CE)2 students during 
the course of the year, A list of over 200 of these skills is included in 
Appendix M, ' ' 

Have (CE )9 students analyzed potential careers for financial and psychological 
inducements, training needs and resources ? 

Rationale, Knowledge of financial and psychological career inducements, 
training needs and resources help students plan more realistically for 
careers and career training. 



Related Learning Activities ^ Use of the Career Information System at the 
computer terminal provides students With a quick knowledge of job 
requirements and rewards for a number of areas in which they may have 
a potential interest. Direct experience at the exploration level gives students 
a first-hand knowledge about what particular jobs are like and about the life 
style of people occupying such positions. A more detailed understanding of 
job requirements and rewards occurs through learning level experiences* 

Findings . A review of a limited sample of eight taped student-employer 
interviews completed as part of the Exploration Package, suggests that 
some students are more adept than others at analyzing jobs for potential 
rewards, training needs and resources, but that most interviews contained 
questions dealing with these issues. 

In February a questionnaire was administered to students in (CE)2, students 
in the Diversified Occupations Cluster of the Cooperative Work Experience 
program at Tigard High School and a random ^ample of juniors and seniors 
at Tigard High School. One of the items .on this questionnaire asked 
students to 'Vrite down the same three jobs you listed in the prior question. 
For each job listed, indicate what you think is the (1) starting monthly 
salary; (2) the highest education required (for example, high school graduate, 
apprenticeship program, college degree, postcollege professional degree, 
etc.); and (3) two special skills required (for example, a dentist needs good 
eye/hand coordination). If you have no idea of the salary or other 
information about a job, write 'Don't Know.'** On the question related to 
job salary, (CE)2 students provided less information than did the CWE or 
THS students, (CE)2 students Jgiew more about the educational requirements 
of jobs than did the CWE students, but not as much as did the THS students. 
(CE)2 students also scored slightly less than THS on the knowledge of 
specific slcills required. (CE)2 and CWE scored about the same on this 
question. In general, none of the three groups had accurate knowledge of 
the jobs. 

FINDINGS FROM COMMON INSTRUMENTS 



This section reports results from those evaluation instruments used commonly 
at all four EBCE sites. The following section of this chapter, *Tindings 
from Unique Instruments," reports results from instruments used at (CE)2 
but not at all three of the other EBCE sites. 



Student Opinion Survey 



During late January, all (CE)2 students who had been in the program since 
fall responded to a survey dealing with their perceptions of (1) the general 



quality of the program, (2) effectiveness of tlie program in achieving specified 
goals, (3) their reasons for joining (CE)2, (4) some characteristics of their 
job site experiences, and (5) their attitudes toward working. The 
questionnaire also assessed the students' knowledge of specifidBnformation 
about occupations of interest to them* W 

The first 3$ items of the questionnaire--common to questionnaires used at 
all four sites working with EBCE programs —dealt with students' 
perceptions of the EBCE program and the world of work, as well as their 
reasons for participating in the progi^am. NWREL evaluators added questions 
requiring (CE)2 students to rate the desirability of ^ specific program goals 
and the program's effectiveness in achieving the goals and to answer specific 
questions about the job site experiences. Students were asked in two of the 
added questions to select three occupations, describe how they learned about 
them and estimate the starting monthly salary, highest educational level 
required and specific skills required, Thege questions we^e placed on 
separate pages to minimize the possibility of students' knowledge of 
occupations affecting their choice of odcupations of interest to them. Students 
also ranked, in question 41, the influence various people had on their decision^ 
to participate in (CE)2.* A copy of the complete Student Opinion Survey as 
well as student responses is included in Appendix C. The following narrative 
describes student responses from that survey* 

During data analysis, survey responses were initially categorized by the three 
groups of students within (CE)2: returning seniors, new seniors and juniors. 
A chi square analysis indicated only"sporadic differences significant at the 
.05 level. Since no pattern of differences was detected, further analysis . 
was done on data for the total group only. 

(CE)2 student responses to those questions used commonly by all four EBCE 
Laboratories were positive toward the program. For all questions the 
majority of students exhibited a positive attitude toward all aspects of (CE)2. 
Especially strong ratings were given for students' enjoyment of {CE)2, their 
motivation, the amount they learned about careers and the capability of the 
staff. The program was rated somewhat less highly, although still positively, 
in areas concerning students' choice of job sites and activities, feedback from 
the program, employer awareness of student needs and the academic program's 
relevance to careers. 

The common questions also dealt with students' reasons for participating in 
(CE)2» Bated most important in their decision to participate were students' 
desire to choose their, own learning styles, to have more independence and 
to prepare for jobs; negative attitudes toward high school were less 
important. Most students indicated that their decision to participate in (CE)2 
was not influenced by their belief that the progranj was easy. 



^ These last three questions were given not only to (CE)2 students, but also 
to students in the Cooperative Work Experience program at Tigard High 
School and a random sample of students at Tigard High School. 

37 



A question developed by NWREL was used to determine student attitudes 
toward specific program goals and perceived success in reaching the goals. 
The four program goals students rated most important were learning to 
(1) work wth others, (2) make decisions and follow through, (3) assume 
responsibilities for themselves and (4) have a positive attitude toward learning. 
The four goals with the lowest average ''importance" ratings were for students 
to learn to (1) prepare for further education, (2) evaluate their own work, 
(3) perform basic academic skills and (4) improve interpersonal and social 
skills. Student ratings of the effectiveness of Ihe program indicated little 
differences in the program's achievement of important versus less important 
goals. Mean ratings of importance and effectiveness for each goal are 
included in Table 8, page 47. 

In describing learning level experiences students indicated that the activity 
was good in terms of interactions With employers and people at the site and 
in terms of organization of the experience. Every student said that he or 
she received clear instructions when necessary and all but two students felt 
free to talk and joke around with people at the work place. Students indicated 
that they usually participated actively, learned ;:?omething new most days, 
were interested in things at their job sites, had a variety of assignments and 
felt the experience would make it easier to work in a regular job. They also 
stated that employers did not get upset when they made a mistake and told 
them when they did a good job. 

The final questions dealt with students* laiowledge of occupations and people 
who influenced them in their decision to participate in (CE)2. In general, 
(CE)2 students most often learned about jobs from actual work experiences 
or from someone who worked at the job. Information was also obtained from 
school or project staff or from reading about the job. (CE)2 students used 
knowledge from actual work experience, the Career Information System and 
a counselor or teacher more often that the CWE or THSj^ group. Other 
sources of information (such as parents or relatives, friends, or reading 
about it) were used by (CE)2 students less frequently than either of the 
other two groups. 

In judging students' knowledge of jobs, answers concerning the three jo 
chosen were scored on a three-point scale: O=don't know or. an incorrect 
answer; Impartially correct answer; 2=correct answer. A member of the 
NWREL staff not associated \vith the EBCE staff was used to score these 
job knowledge items. Identical questionnaire pages for the (CE)2 and 
comparison groups were used. The prededing pages containing the student's 
name and group were detached, leaving only a specially coded identification 
number for each student's sheets. Thus the scorer was unaware of wHich 
pages represented which student groups. ^ * 

Because the three jobs of interest requested from each student were not 
always provided, the evaluators had each job and its set of information 
scored independently rather than computing a total summary score. Thus 
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question 40 on the Student Opinion Survey shows a separate score for each 
job for salarjs one for highest education or training required and two scores 
for special skills I'cquired by the job (since the item asked students to list 
two special skills per job). Questions were rated on the basis of their 
agreement with information in the Occupational Outlook Handbook . A spot 
check on salary information was made by also looking up salaries listed 
in the Career Information System available on the computer to (CE)2 
students. Salary information was considered correct (a score of two) if it 
was within a 25 percent rajnge, plus or minus, of the actual figure listed 
in the Occupational Outlook HandbooK > Salary information was considered 
partially correct (a score of one) if it was within a range of 26 to 50 percenfer^ 
plus or minus, of the actual figure listed in the Handbook. 

The {CE)2 students, on the question related to job s,alary, scored lower 
than the CWE program students or those in the THS random sample for all 
three jobs listed. On the question measuring knowledge of highest education 
or training required, the (CE)2 students scored lower than the THS sample 
on all three jobs but higher than the CWE students on two of the three jobs. 
On the knowledge of special skills required in a job, the (CE)2 students 
scored lower than the THS sample for five of the six skills listed and about 
the same as students in the CWE program. In general, none of the three 
groups had accurate knowledge of jobs and the (CE)2 and CWE students were 
at approximately the same level (except for knowledge of starting monthly- 
salaries where the CWE students seemed more knowledgeable). This is 
probably to be expected, since the (HWE students work for nioney while 
tliose in (CE)2 are not paid for their time at employer sites. 

Two points should be kept in mind in interpreting these findings. First, 
no baseline data were collected in this area. Consequently, the midyear 
data are not growth data, but merely a measurement "^af one point in time. 
The second point has to do with the measurement itself. The questionnaire 
defines ^'career knowledge" as knowledge about salaries, educational 
requirements and job skills. Other questions about working conditions, 
life styles and potential job satisfaction might provide more yalid and 
relevant information about career knowledge. 

In describing factors and people influencing tlicir decision about participating 
in (CE)2, (CE)2 students were influenced much more than either TTIS or 
CWE students by their parents, friends and counselors. Very little influence 
to avoid joining (CE)2 was noticed by any of the three student groups, although 
in general a student's friends produced jlie most negative influence. 
Twenty-six percent of the THS students jdid not participate in (CE)2 because 
of concerns about their future. However, concerns for their future influenced 
93 percent of the (CE)2 students to joinj the program. 
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Parent Opinion Survey 

At the end of January, a Parent Opinion Survey was mailed to parents of 
all 40 students who were in the (CE)2 program since October, Two telephone 
follow-ups^ made to encourage parents to return the surveys resulted in the 
return of 27 surveys (67.5 percent). A word of caution about response 
bias is appropriate here. Since parent naiiies were included on the 
questionnaire, parents with negative feelings about (CE}2 may have been 
reluctant to respond. Although no information was collected, to confirm this, 
it should be kept in mind when interpr ting the results of the Parent Opinion 
Survey. 

Parent responses are groiq)ed into four categories: parent rating of (CE)2, 
Impact of (CE)2 on students, interaction between parents and (CE)2, and 
parental description of students. Each of these categories is summarized 
below* A copy of the Parent Opinion Survey along with the percentage 
frequency distribution of responses is included in Appendix D. 

Parent Ratiilg of (CE) 2* In three groups of questions parents were asked 
to rate the (CE)2 program.. In the first group, they were asked to rate the 
(CE)2 program in comparison to high school. They made the ratings on the 
basis of an overall comparison; the degree to which their son or daughter 
liked (CE)2 over high school; the opportunity to learn about occupations; the 
opportunity, to learn Basic Skills and Life Skills; and the degree to which 
their son or daughter was motivated by each program. For all five questions, 
the (CE)2 program was rated higher than the high school program. 

In a second group of questions dealing with student learning, parents were 
asked to rate the importance Df 15 areas of studeatleaming. and then to rate 
the effectiveness of (CE)2 in accomplishing learning in these areas. Parent 
ratings over all 15 areas were judged by the evaluation staff to be not 
meaningfully different between each sCrea. The five areas judged most 
effectively treated by (CE)2 are the following (in order of most effective, 
next most effective, and so on); '*Be aware of more career opportunities,'* 
'Work with others, " "Communicate with others in a mature way, " "Perform 
specific occupational skills, "and "Have a positive attitude toward- work. " 
Therefore, areas of occupational learning were beei: as being most effectively 
achieved. 

The five areas judged as less effectively treated by (CE)2 are the following 
(in order of least effective, next least effective, and so on): "Be punctual 
and organize their time," "Prepare for future education," "Perform basic 
academic skills," "Make decisions and follow through," and "Evaluate their 
own work." Therefore, areas of self-management and academic performance 
were seen as being less effectively accomplished. It should be noted that the 
average rating even for the lowest area of accomplishment was a positive 
rating. The results of this question are presented in Table 8, page 47. 
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In a thii^d group of questions parents were asked to rate the (CE)2 program 
without reference to other programs. , Parents listed the weaknesses and 
strengths of (CE)2, what changes, if diiy, they would recommend in -tlie 
program, the approach to learning used at (CE)2,^ the effectiveness of the 
^(CE)2 staff, and business and conimunity resources available through {CE)2* 

Many parents listed no weaknesses or recommended changes in regard to 
(CE)2. Weaknesses and changes that were listed dealt mostly with the need 
for more student self-management or" the structuring of (CE)2 to teach 
self-management more effectively. Strengths of the program were listed as 
career development, student-staff relationships and effectiveness of the 
method of learning used* In addition, parents ;rated the program positively 
in terms of several other dimensions mentioned on the questionnaire. 

In summary, the three groups of questions showed, with the few exceptions 
noted, a »very positive rating for (CE)2 by parents* They felt that (CE)^ 
was better than ^the high school program "for their son or daughter, that it 
was effective in important areas of learning and that it was a strong progra,m 
of career education. The main problem parents saw in the program centered 
on student self-management and motivation. 

Evaluation staff inferred a gene raL .rating of the program by parents from 
question 2, which as ked^ parents, if they had to decide again, would they 
want their son or daughter to join the (CE)2 program. Eighty-seven percent 
of the parents responded with yes or definitely yes. 

< ^ 

Impact of (CE) 2 on Students . Six questions in the^, parent survey dealt with 
the impact of the (CE)2 program on students. Most parents (82 percent) 
indicated that (CE)2 had a positive effect on student selection of career 
plans. Ninety percent ..of the parents hi^-d noticed positive changes in their 
son or .daughter that they thought were a result of the program; about thf 
same number reported no negative changes as a result of the program. 
About half of the parents reported no specific problems encountered by their 
son or daughter in the- program. Most problems mentioned dealt with 
student self -management. Staff were rated very high in helping with these 
problems Parents also indicated that students deceived special knowledge 
and skills in the areas' of career development and self-confidence. 

«. 

In summary, parents indicated the major points of impact of the (CE)2 
program to be students^ increased interpersonal skills and maturity and the 
career knowledge ^and experience gained. Primary problems dealt with the 
area of student self- management 

: ^ ' 

Interaction Between Parents and (CE) ^. Parents indicated that they were 
talking more with their son o:^^ daughter about the (CE)2 program than they 
did about the regular school program. Generally, parents were satisfied 
with the amount of information they received about their son^jor^daughter^s 
progress in the program^ and with the overall relationship they had with the 
(CE)2 staff. 
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Parental Description of Students . Three questions evoked parents' descriptions 
of students who, were or should be in the (CE)2 program. When asked what 
they thought of the occupational plans of their son or*daughter in (CE)2, 
68 percent of the parents said ther^weren't any firm plans; 29 percent of 
the parents said the plans seemed good; 4 percent said the plans should be 
changed; and 4 percent said they hadn't discussed the plans with their son 
or daughter. 

When asked what their son or daughter would be doing a year after high 
school, -38 percent said Avorking; 29 percent said attending some kind of 
college; 25 percent said: going, to a business or trade school; and 8 percent 
said joining the military. 

Wheil asked wh^it kind of student they felt would benefit most from the (CE)2 
program, 36 percent said students not happy in a regular high school; 
28 percent said all kinds of students; 16 percent said students unsure of 
themselves and ill need of individual attention; and 16 percent said self- 
motivated students who wanted to learn. . / " 

General Findings of the Parent Opinion Survey . All parents who responded 
to the Parent Opinion Survey rated the (CE)2 program very positively. They 
felt that the main strength of (CE)2 was in teaching career skills and that 
the main weaknesses of the program were in the areas of student 
self-management arid student academic development. 

Employer Opinion Survey ^ ^ - 

The Employer Opinion Survey was mailed to 90 employers participating in 
the (CE)2 program. Employer instructors who worked most closely with 
(GE)2 students were asked to complete the opinion survey. ' Follow-up phond 
calls were made to encourage employers to^ return the survey. Sixty surveys 
were returned. A copy of the Employer Opinion Surv^ey with tabulated 
responses is included in Appendix E. ^ 

The majority of the 60 employer instructors who responded to the survey 
were employed by relatively small companies; two-thirds reported there 
were 25 or fewer employees at their site. The average length of time 
these employer sites have participated in the program is 9.5 months, 
indicating that many of them had students on their sites last year. 

Personal contact with (CE)2 staff or students was the most commonly reported 
way employer instructors became involved with the program. Several 
indicated they had taken the initiative and asked to be involved in (CE)2. 
The reason for their involvement was most often stated to be their perception 
of (CK>2 as a worthwliile program and their conviction that they could be 
of help to students. Six employer instructors said that they became involved 
^ecause they felt that participation v^ould, be of mutual student/industry 

\ 
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benefit. Nearly all respondents indicated their intention of continuixig to 
participate in (CE)2, 'and all who responded said they would recommend to 
other potential employer/resource persons that they also become involved* 

Concerning the impact of {CE)2 on the quality and quantity of work performed 
by regular employees and on company hiring and training practices, 
54 percent of those responding said they saw no impact on their site. 
Thirty-seven percent felt that experience with (CE)2 had a positive impact 
on company training practices. .According to 30 percent of the respondents, 
(CE)2 had a positive impact on the amount of work performed by regular 
employees. This is especially interesting in light of the fact that 80 percent 
of those responding Indicated that their site coiild handle only two or less 
students and the two most frequently cited reasons for limiting the number 
of students were space/equipment limitation and the possibility that the 
presence of students "might disrupt other workers* 

Several qu^ptions dealt with the issue of what actually happens to students 
Avhile they' are on the emjpioyer sites. An average of about six hours per 
week was reported spent with students on exploration level placements and 
learning level placeihents. In response to a list of possible supportive 
services, the most frequently checked by employers as those provided at 
employer sites were talking about job opportunities, talking about activities 
occurring at the site,' evaluating individual student's' assignments, supervising 
students in, performing specific job-relkt6d tasks at their sites and helping" 
stttdepts plan assignments* In response to a questjLon of what students can 
learn on -job sites that they could not learn in a regular classroom, over 
^ percent of the respondents cited the students' opportunity to gain first-hand 
knowledge of the demands of a realistic situation. 

No discipline problems with students on their site had been encountered by 
more than half of those responding. Thirty-one percent said that if discipline 
problems did (or should) occur, they handled (or would handle) them 
themselves. Most of the employer instructors felt that (CE)2 students 
demonstrated a positive interest both in 6ie program and in their particular 
employer site. About half of them said the presence of (CE)2 students at 
their sites had produced a positive reaction from other employees, benefiting 
them in such ways as increasing their awareness of yputh or increasing 
their interest in their own work. 

Most employer Instructors felt that (CE)2 staff had provided them with enough 
information to help them direct student activities at their site. But they 
did not receive adequate feedback on what happens to Students after fchey 
leave the employer site or on the effectiveness bf^heir work with students. 
The majority reported the frequency of their communication with (CE)2 staff 
to be ''once or twice a month" or less. 
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The most frequently eited weaknesses of the program were students' 
inability to handle the freedom of (CE)2 and "problems in organization." 
On the other hand, the most frequently cited strengths of the program were* 
"(CE)2 personnel/organization/* helping students Jeam about careers and 
helping them see what real-life situations are like. . > 

Along with parents, students and (CE)2 staff, employer instructors were 
asked to rate the perceived importance and effectiveness of various learning 
outcomes. Nearly all the learning outcomes listed were rated by employer 
instructors as important or highly important. Two outcomes rated 
somewhat lower than the others were the ability to "perform basic academic 
skills" and the need to "prepare for further education." Employer ratings 
of program effectiveness were above average for all areas. Those rated 
somewhat less effective than others were students^ learning to "be punctual 
and organize their time," "evaluate their own work," "perform basic 
academic skills," "think through and solve problems," and "prepare for 
further education^" 

Visitor Questionaaire 

The Visitor Questionnaire was* designed to be filled out by all individuals 
who visited (CE)2 during the year. Due to oversight, however, only a 
small number of visitors were asked to fill out the questionnaire. 
Questionnaires from two categories of visitors are summarized here: 
National School Board Association (NSBA) Executive Committee members 
who visited {CE)2 as a groi^) in conjunction with an NSBA meeting in Portland, 
October 12, 1973, and local visitors composed of teachers and administrators 
(50 percent) and other community people (50 percent). 

All nine NSBA committee members completing the questionnaire reported 
positive or very positive impressions of the (CE)2 program. Five of the 
17 local visitors reported some reseiTations. Both groups agreed that the 
major strengths of the (CE)2 program were its highly motivated staff and 
its orientation to the real world. Both groups agreed that the major 
weakness of the program, was its cost. The local group was also concerned 
about the program's ability to deal with the college- and profession-bound 
student. .They indicated that more able and highly motivated students were 
needed to really test ^-he program. 

When asked what parts of the total project they would like to see tried in 
other school districts, ,about half of each group expressed interest in the 
entire (CE)2 system. 'Interest was fairly evenly jspread over the other, 
components of the program, with only two people (one from each group) 
expressing interest in the (CE)2 record system. An insufficient number of 
questionnaires were collected during the second semester. Consequently, 
further analysis was not performed. 
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Project Director Questionnaire 



The Project Director Questionnaire was designed to obtain common program . 
data for the four EBCE programs. Responses on this questionnaire synthesize 
the observations of both the NWREL career education program director and 
the (CE)2 project director with some data bein^ supplied by the evaluation 
staff. The questionnaire summarizes major aspects of the entire program: 
staff, employer contacts, student selection, credit assignments, employers- 
and advisory board. These areas are summarized below. The completed 
Project Director Questionnaire is contained in Appendix F.* . 

The questionnaire indicates the frequency of (CE)2 staff contacts with 
employers to be "about once or twice a week" during exploration level 
experiences and "about once every two weeks" during learning level 
experiences. The student /employer relationship is documented on an 
employer-signed time card; a student activity log (journal); advance employer 
approval of project assignments and final employer approval of student 
project work for credit; and periodic employer reviews of student site 
performance. Students average spending 38 percent of their time on 
employer sites. 

With reference to student selection, the project director reported that 
altliough most volunteers have been accepted, "we have attempted to increase 
the number of 'self-directed' students in relation to the total student body. " 
This year's planned enrollment of 50 students was met. 

Decisions regarding assignment of credit for students' program work are 
made by designated program personnel, who "translate program experiences 
into recommendations for credits; no credit awards are made directly." 
Students receive diplomas from their local high school as well as certificates 
from (CE)2. No problems have been encountered to date in getting uther 
institutions to recognize the credits and diploma granted by the (CE)2 
program. 

Of the students who have left the program since Sisptember 19*73, five of the . 
nine leaving voluntarily , did so because they wanted to return to high school. 
Only two students have been involuntarily terminated during that period. 

The number of employer resource persons accepting students for job site 
experiences was listed as 74 for exploration levels and 32 for learning 
levels. Only three students have been dropped from work sites. Students 
at job sites do not perform tasks that would otherwise be assigned to a 
regular employee and are not paid for work done as part of the program. 
However, 20 to 25 students have been hired by employers participating in 
the program for work outside of program hours. 

* The Project Director Questionnaire is based on data fromuthe^flrst semester 
only. 



Comparison of Student Learning Outcomes by Students, Parents, Staff and 
Employers 

A comparison of ratings by students, parents, staff and employers regarding 
their perception of the importance and effectiveness of 15 student learning 
outcomes is contained in Table 8, The center of each horizontal line shown 
in the table indicates the mean (average) rating for that group on the particular 
student learning outcome. The length of the line indicates the amount of 
variation in Responses from a given group to a particular outcome and 
includes the ratings given by two-thirds of each group. 

Multiple comparisons are possible. For a given learning outcome perceived 
importance may be compared among students, parents, staff and employers. 
The length of the line indicates how much agreement or disagreement there 
was within a particular group in rating a given outcome. For a single 
outcome, how important a given group thought that outcome was and how 
effectively they felt the program was accomplishing that outcome also can be 
compared. Finally, the outcomes that a single group of raters considered 
highest or lowest in importance and highest or lowest in effectiveness can be 
compared. (For further information, see Table 5, page 22.) 

One caution should be kept in jpfitnd. Even though an identical rating format 
was ,used on the opinion surveys for students, parents, staff and employers, 
it cannot be assumed that the same concept of "highly important" or "highly 
effective" was shared by each group or even by members within the same 
group. Thus the concept of "highly effective" may have meant something 
different with staff than with students. 

Each of the 15 student learning outcomes was given an average rating of 
3 or higher (on a 5-point scale) by students, staff, parents and employers, 
thus indicating a supp>ort for the goals of the program. Learning outcomes 
considered especially important by all four groups included: assuming 
responsibility for themselves, making decisions and following through, 
communicating with others in a mature way, working with others, thinking 
through and solving problems, having a realistic attitude toward self, having 
a posiHye attitude toward work and learning, and improving interpersonal 
and social skills. 

The student, staff, parent and employer groups all gave an average rating 
of 3 or higher (oi^ a 5-point scale) for effectiveness, for 11 of 15 student 
learning outcomes listed. Student outcomes rated most effective were 
performing specific occupational skills, assuming responsibility for 
themselves, communicating witli others in a mature way, wprking with 
others and having a realistic attitude toward self. 
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Tabio S 




A SUMMARY OF RATINGS ON FIFTEEN STUDENT LEARNINGS , 
BY SrUDKNTS, PARENl^, STAFF AND EMPIjOYERS* 

liow Important Do You How Effective Do You Fee! the Project 

Feel This Learning Is ? Has Been in Aceomplishirm This I/'amint; ? 

Not , Highly Not llighl) 

Importanl Important Effective Effeetive 



Students U^arii To: 1^,2 3 4 0 1 3 4 5 



Perform specific occupational 


- 1 ^ 




1 

> ^ 


1^ 

Be punctual and or^ani/e 
their time 


1 




1 =. 


Assume responsibility for 
themselves 






1 


1 




„^ 


Make c^clstons and follow through 






H 




— 1 


\ 




Communicate with others in .» 
mature way 








1 






^Be aware of more career 
opportunities 


1 — 


















Work with otherij 


H 


f 


— — 1 — 


Evaluate their own \^ork 







, — . — 1^ 


Perform basic ncademie skills 






— 1 — 


ft \ 
\ 

Think through and solve 
problems 




1 


... 1 

"A- 
— 


• ~ 


Have a reallf^tle attitude toward 
self. 


1 




' 1 

^. -f.---. 

-.:-:i,T.-.- 


Ma VI' ;i positUe attitude touani 
work 






1 






Have a positive attltuut^ toward 
learning 


1 — 

— \- 


-"-••--.I 


Prepare for further edu<atlon 


1 

^ 

— • — • I" • — • 


1 

1 


Improve interpersonal and 
inrH! ".kills 

L 


1 

' • ll' M ' » • rl 


— X- — ~' 



^ -jp/a , — I — !.: » ti' M > I ' rt I : „ — 

•('oDK. — ^Stmtcnt Hatinji'> IIk ^laphs indicate the nean rating and )ne standani deviation a>i<^H( jnd 

Paieiu Ruimgs belou the meap. The fmiill veitlcal linei* shown a» tick marks njt tht 

— — Staff HatinKs Kraph represent the mean ralinjjs. The length of each horizontal line 

Employer Ratings repre««enis two-thirdf^ of the pei«ponfto<» by thai group. 
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FINDINGS FROM UNIQUE INSTRUMENTS 



Comprehensive Test of Basic Skills 

The Comprehensive Test of Basic SkUls (CTBS), Lev^l 4, Form R, was 
administered to {CE)2 students and to a randpm sample of Tigard High School 
(THS) students in the early fall of 1973 and again in the spring of 1974. 
Because of questions concerning the representativeness of the THS seniors 
in the sample, (see Interim Report*) the only comparison students poettested 
were the THS juniors. Raw score class means and standard deviations on 
the pre- and posttests for the juniors' from (CE)2 and THS and the seniors 
from (CE)2 are included in Table 9. 

Table 9 

CTBS RESULTS 



CTBS 
Sub SCO re 


Groups Tested 


Tigard 
Juniors N=25 


(CE)2 
Juniors N=10 


(CE)2 
Seniors N=23 


Pre 
X S 


Post 
X S 


Pre 
X S 


Post 
X S 


Pre 
X S 


Post 
X S 


Reading 
Language 
Arithmetic 
Study Skills 


G4.5 11.4 
62.0 9.6 
69.4 16.7 
33^ 0 G. 6 


65.9 12.3 
61.4 11.9 
67.0 18.6 
34.6 6.8 


52.4 14. 6 
50.0 14.1 
54.4 20.0 
23.0 11.0 


52.3 19.3 
54.2 14.6 
60.0 23.7 
30.5 11.8 


52.7 13.1 
51.4 14.0 
47.7 16.0 
26.3 9.2 


56.7 13.2 
53.2 15.0 

56.8 17.0 
30.0 7.5 



A series of four t^ tests for matched data was run on the combined (CE)2 
student CTBS data. A summary of this analysis is included in Table 10. 

Tabic 10 



(CE)2 CTBS PRETEST— POSTTEST DIFFERENCES 



Subtest 


Mcjin , 






Pretest 


Post test 


Gain 


t^ Value 


Reading 


52.6 




55.3 


2.8 


2:37* 


Language 


51.0 




53.5 


2.5 


1.32 


Arithmetic 


49.7 




57.8 


8. 1 


3.98*"* 


Study Skills 


25.3 




30. 1 


4.8 


2.90** 



*p<.05 
p<.01 

* Experience-Based Career Education FY 74 Interim Evaluation Report , 
NWREL, Portland, Oregon: March 1974, pp. 17-18. 



It is noted that statistically significant growth occurred on all CTBS subtests 
except Language. This is especially significant when compared to (CE)2 
student growth in Basic Skills during the first year of program activities 
in 1972-73. During that year, no growth in this area was detected by the 
CTBS. 

To compare^CCE)2 studejit growth in Basic Skills with that of the comparison 
groups, a univariate analysis of covariance was run on each of the CTBS 
subscores using the JOHNEYX program. * Pretest scores were used as the 
covariates. The analysis was run comparing THS juniors both with the 
(CE)2 juniors and with the total (CE)2 student population. No significant 
differences were Jound in either analysis* In other words, the {CE)2 
students gained as much in Basic Skills as did the THS students. 

Further analysis, using JOHNEYX, was undertaken to see if differential 
growth was exhibited in arithmetic and/or reading by those (CE)2 students 
who received tutoring in either or both of these areas. The analysis of 
covariance indicated no significant differences. . However, the number of 
hours of tutoring or specific nature of the individualized instruction were 
not accounted for in the analysis. 

Newspaper Reading Exercise 

A sample of eight (CE)2 students scoring below the ninth grade level on the 
CTBS Reading pretest were administered the Newspaper Reading Exercise 
in January 1974 and again in May 1974! The average score in January was 
5.50 with a standard deviation of 1.92 while the mean and standard deviation 
in May were 11.25 and 3.2g respectively. A _t test for correlated data was 
run and indicated that this difference was significant at the .01 level. 
Limitations in the instrument and its administration are discussed on 
page 99. 

Writing Sample 

To assess changes in writing skills of the (CE)2 students, a writing test 
was administered to the (CE)2 and CWE students during the first and last 
six weeks of the year. Two outside high school English teachers evaluated 
the samples in the blind (not knowing to which group the student belonged nor ^ 
knowing whether the sample was from pretest or posttest). Ten criteria were 
used to judge each sample. The inter-rater reliability was .485. Because 
of confused test administration instructions, the results from the CWE group 
were not valid for comparative purposes. 

* JOHNEYX is a FORTRA^N program that checks the data for homogeneity 
of regression lines before proceeding, to do the analysis of covariance if 
the regression lines are homogeneous, or the Johnson-Neyman Technique 
if they are not. 



(CE)2 student pretest and posttest means and standard de\dations for each 
criterion measure *are sumnjiarized in Table 11. While positive change is 
noted in scores on eight of the ten scales, none was significant when 
tested with a t_ test for correlated data. 

Table 11 

PRETEST AND POSTTEST MEANS* AND STANDARD DEVIATIONS 
OF (CE)2 STUDENTS ON THE WRITING SAMPLE (N=23) 



Writing 
' Scale 


Pretest 


Posttest 


t 






2.69 


2.86 


1.73 




s 


.55 


.60 




T ncripal FlpvplonTTipnf 


X 


2.76 


3.10 


1.73 




s 


.87 


.86 


• 


L/iani/y 


Y 


2.73 ' 


2.84 


.60 




s 


.67 


.74 




Pronouns 


X 


2.60 


2.34 


-1.01 




s 


.87 


1.03 




Subject-Verb Agreement 


X 


3.04 


3.34 


1.66. 




s 


. ol 


. 40 




Capitalization 


X 


2.82 


2.84 


.14 




s 


.92 


1.05 




Spelling 


X 


2: 71 


2.82 ; 


.67 




s 


.86 


.87 




Legibility 


X 


3.02 


3.06 


.21 




s 


. 91 


.85 




Punctuation 


X 


2.82 


2.58 


-.71 ' 




s 


.77 


1.04 




Tone 


X 


3.65 


3.67 


.06 




s 


.69 


1.11 





* Maximum score possible on any variable is five. 
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Semantic Differential 



A semantic differential^ designed to measure attitudes toward the concepts 
of Me, School, Adults , Learning , Work and Decision Making , was 
administered to (CE)2 students in the fall, at midyear and again in May, 
Figure 2 displays a graphic summary of the semantic differential data. As 
can be seen, students demonstrated a positive change in all six areas during' 
the first half of the year. From midyear to May, however, the rate of 
change either decreased or a slight drop was indicated. 

I 
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4? 

40 Pre ' Mid Post 

Test Scores 

Fig. 2. Pretest, mulyear and posttest means of the (CE)2 
students on the Scmantie Differential scales. 
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A multivariate analysis -of variance using pre-, midyear and posttest scores 
as repeated measures was computed.* A linear test (using orthogonal 
polynomials) was significant for the concepts of Me, School , Learning and 
Decision Making in a positive direction. However, when the step-down 
F ratios were examined only the concepts of Me and School were significant. 
This resulted from the high correlation of the Me and Learning scales and 
the School and Decision Making scales. The concept of School alsa had a 
significant quadratic effect indicative of a midyear to posttest score loss. 

Psychosocial Maturity Scale 

The Psychosocial Maturity Scale was administered to all the (CE)2 and C\VE 
students and to samples from THS and OSC in the fall. In January, a 
random half of the above groups and all the CWE students completed the 
instrument again. The remaining students responded to the instrument in 
May. 

Pretest and midyear group means and standard deviations from those 
students tested at midyear are included in Table 12, Pretest and posttest 
statistics for the remaining students are displayed in Table 13. Pretest 
means vary slightly oa each scale from table to table due to sampling and 
measurement error. The results for the (CE)2 students are displayed 
graphically in Figure 3. The general pattern of change on the PSM follows 
that noted on the Semantic DifferentiaL The rather dramatic positive 
change evidenced during the first sent^ester was in part tempered by a 
reduction or negative change in the second semester. 
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* Version 4 of **Multivariance-Univariate and Multivariate Analysis of 
Variance and Co variance: A Fortran IV Program***yWa^ used for the 
multivariate analyses in this report. 



Table 12 



PRETEST AND MIDYEAR MEANS AND^.STANDARD DEVLAT-fONS 
FOR THE PSYCHOSOCIAL MATURITY SCALE 
FOR (CE)2 AND THE COMPARISON GROUPS 



Scale 


Groups Compared 


(CE)2 
N=16 
Pre Midyear 


CWE 
N^12 
Pre Midyear 


OSO^ 
N=46 
Pre Midyear 


THS 
N=17 
Pre Midyear 


Work X 
S 


24.6 26.9 
5.16 4.77 


25.9 30.2 
5.25 5.46 


28.3 30.4 
4.47 4.39 


27.4 31.2 
5.47 3.P2 


Self-Reliance X 
S 


28.9 32.0 
4.42 4.63 


27.3 33.2 
4.94 5.27 


30.6^ 32.3 
4.43 4.13 


29.9 34.2 
5,48 3.90 


Identity X 
S 


,27.2 30.5 
5.10 5.99 


25.7 . 28.6 
3.58 4,72 


30.2 31.6 
4.33 4.48 


^0.2 33.7 
5.09 4.69 


■ — . 

Communication X 
S 


22.8 24.9 
3.19 5.54 


23. 7 26.7 
5.84 5.77 


25.1 27.3 
3.92 4.88 


25.3 29.8 
5.46 6.42 


Role X 
S 


30.9 33.6 
4.73 3.94 


29.0 32.5 
4.94 " 4.01 


33.1 33.6 
4.55 3.93 


32.6 35.6 
5.11 2.96 


Trust X 
S 


,25.1 28.8 
3.22 2.82 


25.3 30.5 
4.03 3.53 


28.0 28-8 
4.07 4.78 


28.3 30.9 
4.16 4.92 


Social X 
Commitment 

S 


31.2 35.4 
3.92 4.27 


30.3 33.8 
4.89 4.54 


32.1 33.8 
4.58 5.30 


31.1 *36.5 
4.77 4.45 


Tolerance X 
'S 


29.9 M I 
3.79 4.46 


28.1 35.8 
3.58 5.61 


30.2 35.5 
2.83 5.25 


29. C 37.4 
3.94 5.71 


Chance X 

1 


29.4 35.2 
3.68 4.90 


27.9 34.2 
3.45 6.85 


30.4 34.4 
3.06 5.34 


29. 3 34. 6 
4.06 5.99 


Social' X 
Desirability 

S 


22.1 19.9 
2.82 3.36 


21.3 20.4 
2.46 2.45 


22.1 21.1 
3.05 3.47 


22.8 21.17 
2.66 3.04 



Table 13 
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PRETEST AND POSTTEST MEANS AND STANDARD DEVIATIONS 
FOR THE PSYCHOSOCIAL MATURITY SCALE 
FOR (CE)2 AND THE COMPARISON GROUPS 



Scale 








Groups Compared 






/ 


Pre 


(CE)2 
N=14 


Post 


C6C 
N=30 

Pre 


- 

Post 


Pre 


THS 
N=18 


Post' 


- • 

Work 


„_ 
X 


23.5 


f 


28.0 


28. 7 




» Ol. 0 


27.8 




30^7 




s 








4. 00 




4.79 


5.80 




4.85 




V 


26.5 




29.6 


30,7 




32.3 


30.1 




32.7 


Self-Reliajjce 


s 


A O Q 




A 

4. 00 


4. 26 




4. 75 


4 70 




4.73 


Identity 


X 


26. 7 




30.2 ' 


30.6 y 












- 


s 


A CO 

4.52 




4.2£fa. 


3. 98 




4.47 


R 44 




5 93 


Communi- 


X 


23.4 




26.2 


25.8 




Zo. (J 


26.7 




27.2 


cation 


s 


6.11 




4.83 


5. 06 




4.93 


4 fi7 




4 97 


Bole 


X 


2872 




30.6 


i 

31.7 




33.9 


31.8 




33.8 




s 


3. DO 




5.10 


5.12 




3.64 


4 QQ 




3" 76 


Trust ^ 


X 


23.4 




28.2 


27x5 




29.1 


27. 1 


/ 

/ 


OA O 




s 


4.73 




4.87 


4.73^ 




3.91 


5.59 




6.10 


Social 


X, 


31.3 




32.7 


32.3 




34.0 


33.5 




36.3 


Commitment 


s 


6.60 


*»5.03 


4.52 




5.64 


4.69 




3.56 
























Tolerance 


X 


34.3 




34.8 


36.1 




37.6 


36.7 




38.0 




s 


5.07 




5.79 


5f-14 




5.06 


5.02 




3.32 


Change 


X 


31.4 




31.2 


30.0 




35.1 


32.5 




33.7 


s 


4.55 




4.73 


4.50 


5.62 


4.68 




4.01 


Social 


X 


21.8 




22.8 


20.8 




21.6 


20.9 




20. 1 


Desirability 


s 


3.30 




3.84 


2. 98 




3.80 


3.23 




3.18 



54 
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PSM Scale " 



-Tru'st 



.Work 



'Identity 
Self 

Reliance 
Communication 

.Role 



Social 

. Commitment 



Tolerance 



Change 




-2 

Pre-Mid Pre-Post 
Group Group 

Fig. 3. \CIJ)2 midyear and posttest mean ^rc changes on tho PSM. 55 
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A two-way multivariate analysis of variance was run. Factor one consisted of 
the pre-, midyear and posttest PSM scores. The second factor was group: 
{CE)2» THS or OSC, (The CV/E sample was not included since there were no 
posttesj^scores on this group.) 



Orthogonal polynomials were used to test the first factor. All nine subscales had 
significant univariate effects on the linear test,, ^owever, only the Work, Trust 
and Tolerance subscales were significant on a step-down F rati6. Since the 
subscales were examined in the same order as they appear in Table 12, these 
results indicate a high correlation betwen subscales. The subscale Work is^ ^ 
especially highly cora^elated with all other subscales except Trust, Tolerance and \ 
Change, The Self -Reliance, Role, Tolerance and Change subscales also had 
significant univariate effects on the quadratic test, with only the Self-Reliance 
subscale having a significant step-down F ratio. 

On the second factor, the THS sample was significantly higher than the (CE)2 sample 
on the univariate tests of the Communication, Trust and Social Commitment subscales 
over the entire year. However, only the Change subscale had significant unique 
variation on the step-down F ratio. The OSC sample was significantly higher 
than the (CE)2 sarnple on the univariate tests of all subscales except for Social 
^ Commitment and Tolerance, However, only the Work, Social Commitment and 

y ^ Change subscales had significantly unique variances on the step-down F ratios. 

There were also no significant interaction effects, indicating thai although the (CE)2 
group had lower pretest scores the rate of change over the course of Ihevcntire year 
was basically the sanfe for all groups. Analysis of total change at the summary 
scale level was undertaken for the (CE)2 students. The analysis, three t_ tests 
for correlated data, is summarized in Table 14, 



table 14 

(CE)2 PRETEST— POSTTEST RESULTS ON TllE 
PSM SUMMARY SCALES (N=14) 



Summary 
Scale 


Mean 


Gain 




Protest 


Posttest 


Individual 










Adequacy 


76.9 


87.8 


lb. 9 


4,38* 


Communication 


75.1 


85.1 


10.0 


3.66* 


Socral Adequacy 


97. 1 


98.9 


1.8 


.44 



* P<.01 
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(CE)2 students made substantial growth on both the Individual Adequacy and the 
Communication scales, but did not significantly increase their score on the 

Social Adequacy scale. 
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Career Maturity Inventory 

The Career Maturity Inventory was administered to all groups ((CE)2, OWE, 
THS and OSC) in the falL In January, the Attitude Scale and three of the 

' Competence Tests (tCnowing Self, Knowing Job and^ Looking Ahead) were 
administered to a random half of (CE)2, THS and OSC. The CWE students 
all were administered the CMI Attitude Scale only .at midyear because of 
scheduling difficulties* The data from these testing sessions are summarized 
in Table 15. The table shows y^ry little change between pretest and midyear 

' means for any of the groups. 

Table 15 

PRETEST' AND MIDYEAR MEANS AND STANDARD DEVIATIONS 
ON THE CAREER MATURITY INVENTORY SUBSCALES 
FOR (CE)2 AND]THE COMPARISON GRv^UPS 



• CMI 

Subscal^s * 


Groups Compared 


(CE)2 
N-IO* 
Pre Midyear 


CWE 
N^15 
Pre* Midyear 


OSC 
N-46 
Pre Midyear 


THS 
N=^18 
Pre Midyear 


Attitude X 
S 


32.7 33,7 
4,67* * 6,20 


.33,3 33,5 
^5,45 5,85- 


35.3 36.2 
5.21 6.21 


36.1 36.7 
4.92 5.09 


Knowing X 
Self 

s. 


•10.2 9.74 
3,88 4,23 


A. 1 
2.95^ 


12.4 12.9 
J3.89 ^4.23 


13.3 13-. 8/^ 
3. 74 4.58 


Knowing X 
Job 

S 


12.8 13,5 
5.49 5,15 


15. 1 — i 
2.37 


I 15.7 15.0 
3.20 '3.70 


16.6 ' 17. 9 
1.89 2.32 


Looking 'X 
Ahead 

S 


10,3 9,a3 
6,01 5,40 ^. 


lOTS 
2.98 


12.8 13.1 
3.99 4.34 


13.5 14.8 
3.55 '3.98 



Only the Attitude Subscale was administered to the remaining random half ^ 
of students in May because of the evaluation leam^s concerns about the lack 
of validity and relevance for the competency ^ections* The pretest and 
posttest means for the end of year testing groups are summarized in 
Table 16. 
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Table lo 



PRETEST AND POSTTEST MEANS AND STANDARD DEVIATIONS 
ON THE CAREER MATURIIT INVENl^ORY ATTITUDE SCALE 
FOR (CE)2 AND THE COMPARISON GROUPS 



Scale 


Groups Compared 


(CE)2 
N-15 
Pre Post 


THS 
' Pre Post 


■ OSC 
N=30 
Pre Post 


CMI Attitude X 
S 


32.1 36.4 
7.87 4.22 


3G.7 * 36.4 
4.32 7.63 


36.1 38.3 
6.27 4.93 



A test for cbrYelated data run on the (CE)2 students' scores yielded a 
t^ol 2.71 which is significant beyond the .02 level, indicating a positive 
growth as measured by this instrument. 

An analysis of tJ^variaiice (with the pretest score as the covariate) run on 
the data indicates that differential growth among groups is not significant. 

Attendance Data 

Fil.e data indicate that (CE)2 statists, while attending high school at THS 
during the 1972-73 school year (1971-72 for seniors who have been in 
(CE)2 for two years), were absent an average of 16.4 days or 9.25 percent 
of the time. During the past year at (CE)2 they were absent an average 
of 12.3 days or 8.9 percent. A t^ test for correlated data yields a t^ of -1.44 
and a probability of .16. This, year's attendance rate is not significantly 
different from that of last year. This continues the trend noted in the first 
semester where the attendance of (CE)2 students had not changed from the 
first semester of their previous year at the high school. 

Attendance data (1972-73 school year) from a random sample of students 
from THS indicate that they were absent on the average 11.2 days or 
6.3 percent of the time. (There were 177 possibjie school days for the 
THS students and an average of 138 for (eE)2 students, since some students 
were in the program for only part of the year.) A t^ test comparing the 
percent of days absent by the (CE)2 and THS students yiei<Jed a t_ of 2.32 
which is significant at the .05 level. The (CE)2 students, then,i are 
absent mor^ often than a sample of THS students. 

Comparison of (CE)2 attendance data with that from the OSC was undertaken 
for the first semester only (due to the availability of data). (CE)2 
absenteeism for the first semester averaged 7.5 days compared to 7.0 for 
the OSC students. No statistical tests were run on these data. 



{CE) 2 Staff QuestioDPaire 



The Staff Questionnaire was completed anonymously by each of the (CE)2 
staff members in lat6 February. Ratings by staff of the importance and 
effectiveness of 12 student learning strategies and 15 student learning 
outcomes were collected. With the exception of student journals and employer 
seminars, the average rating of all learning strategies was high" and staff 
agreed generally on the relative importance of each learning activity. (The 
one exception to this was for tutors, where there was rather wide 
disagreement.) 

For all learning strategies except journals, staff rated "effectiveness" 
substantially lower than their respective "importance;" for journals, 
importance and effectiveness scored equally low. Three of the learning 
strategies rated high in importance but relatively low in effective 
implementation were (1) learning level processes, (2) the student 
accountability system and (3) group activities. In rating student learning 
outcomes, staff also tended" to mark them higher in importance than 
effectiveness. In general, staff rating of the effectiveness of learning 
strategies was also lower than the ratings by students. This possibly 
reflects the staff's higher expectations for each learning strategy and their 
keen awareness of problems involved in implementing each learning strategy. 

On several open-ended questions regarding factors facilitating or hindering 
success of the program, staff capabilities were frequently cited. For 
example, the staffs concern for the students was seen as contributing to 
the success of the program; lack of staff unity was perceived as limiting 
the program^s success. Five of the staff thought the CTBS provided useful 
assessment infoiination. Social skills were seen by five of the staff as 
the area of greatest student growth. Two of the staff saw the least 
growth being made in the area of systematic study of career opportunities 
and work trends. The major changes suggested by the staff were more 
selective student recruitment in the future and a redefinition of staff roles ^ 
needed in the prpgram. 

A copy of the Staff Questionnaire and a tabulation of responses is included 
in Appendix H. 

Student Staffing 

Purposes and Procedures. During, the summor of 1973, (CE)2 staff and an 
outside consultant* designed a plan whereby each (CE)2 student would be 
discussed systematically by staff throughout the 1973-7,4 school year. This 



* vibr. Michael Ward, a practicing clinical psyd^ologis^fronTBerkeley, 
California, has had extensive experience in counseling and has worked 
with (CE)2 staff over the ps^.st year in refining. the guidaxice component. 



system, referred to as "student staffing, was developed to (1) improve 
communications among the (CE)2 staff regarding the problems and behaviors 
of individual students; (2) identify ways to help slu'dents in specific problem 
areas; and (3) provide a systematic basis for evaluating some of the 
nonacademic outcomes that (CE)2 is designed to help students achieve. 

At each weekly staffing session, 15 to 20 students* were discussed for 
several minutes each in terms of four topics: responsibility, cooperation, 
. personal interactions and enthusiasm. Staff comments were confined usually 
to behavioral observations of a student rather than general feelings about 
the student or nonspecific examples. The student coordinator recorded 
staff observations on each student, together with the agreed-upon course of 
action to be followed. 

In the opinion of the (CE)2 staff and evaluators, the staffing procedures were 
considered successful in terms of improved interstaff communications and 
providing students assistance in problem areas. Because of (CE)2 staff 
role delineation, each student had, direct contact with at least four staff 
members. Some of se staff observed the student primarily at an 
■Employer site; others observed the student only at the learning center. 
Since responsibility for counseling students is spread across all staff, it 
was essential that each staff member have a clear idea of how a student 
was progressing in all phases pf the project. Student staffing sessions 
also enabled each staff member to learn how others respond to a given 
student under certain circumstances, thus reducing opportunities for 
s.tudents playing one staff member against another. Also, because (CE)2 
staff are interested in all phases of. a student's development, not just his 
or her academic and career knowledge, it was essential that staff share 
insigl^ts into each student's interests, attitudes and concerns in order that 
eaqh may help students in specific problem areas. Such insights allowed 
staff membe:^ to place students at appropriate employer sites, develop 
meaningful projects and genially be attentive to their individual iieeds. 

The third purpose for student staffing —evaluating non^eademic outcomes — 
has been difficult to operationalize. Staff agreed that standardized tests 
and paper and pencil questionnaires do nqt adequately assess nonacademic 
behavior changes of students. However, few established research techniques 
exist for using systematic staff observations for documenting and evaluating 
group student growth. This then became the challenge of using student 
s^ffing in (CE)2 for evaluation purposes. 

Reliability of Observations , To assess the reliability of student staffing 
records, a member of the evaluation staff observed six staffing sessions 
during the year. Independently of the student coordinator he recorded^ 
observable behaviors described by the staff ^and then compared his notes 
with those of the student coordinator. 
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* students needing special attention are discussed separately as ^'emergencies. '' 

60 ^..^ 



An interrecorder agreement rate of 68 percent was reached in October 
and an agreement rate of 76 percent was achieved in Januarj\ October 
comparisons involved notes on 26 students and the January comparisons 
Involved 9 students. No cases were found of direct contradiction between 
the two recorders. The only discrepancies occurred where one or the 
other recorder wrote down a staff comment not recorded by the other. 
New guidelines were established in February to clarify which behaviors 
the staff members desired to be recorded. 

Analysis of Staffing Records . For each of the (CE)2 students in the project 
since September, a summary sheet of student behaviors, consolidating 
behaviors recorded weekly by the student coordinator throughout the year, 
was prepared separately by the evaluation staff. Of the .37 students 
remaining in the project since September, 6 were. systematically discussed 
5 times during the year, 18 were discussed 6 times, 11 were discussed 
7 times and 2 were discussed 8 times. Of the 4 behavior categories being 
recorded, over 70 percent of the staff -recorded observations of students 
were classified by. the evaluation staff as being in the areas of cooperation 
or responsibility. The remaining behaviors dealt with adult or peer 
interactions and with manifestations of student .enthusiasm. . , < 

In addition to categorizing observations by type of behavior, the evaluation 
staff was also interested in identifying behavioral changes noted. Three 
sources were used for identifying these changes. In some cases the 
syntax of the recorded behavior indicated the change; for example, a staff 
member might state that a particular student was now less belligerent in 
his conversations wth ^taff. In addition, one section of the. Student Staffing 
Record, filled out by the student coordinator, was specifically designed for 
recording behavior changes. Finally, ^the evaluation staff compiled a list 
of each student's behaviors discussed in staffing, making comparisons over 
time. 

In reviewing*^ the student staffing notes over the year for each student, the 
evaluation team looked for patterns of change contained in the recordings. 
Since various staff members observed and reported on students from 
different perspectives and since the students themselves sometimes varied 
from day to day, the summary judgments made by the evaluation team must 
be regarded as subjective. During many of the staffing sessions no 
systematic attempt was made to review some of the earlier comments made 
by the staff about a particular student. As a result, no indication exists, 
in many cases, as to whether a change has occurred in a particular student 
since the latter sessions often covered different aspects of the student's 
behavior than were reported in ^rlier sessions. 



A review of the rQcorded behaviors classified as dealing with responsibility 
of each of the 37 students led the evaluators to judge that 12 students had 
demonstrated a pattern of substantial positive gain in assuming responsibility 
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for their learning, 6 had indicated a decrease in this behavior and 
insufficient data existed to form a clear pattern for the remaining 19 students* 
Using a five-point behavior rating scale for each of the four categories of 
interest, in June the evaluation team, asked the student coordinator to rank 
each student as above average, average or below average on the four 
behaviors of responsibility, cooperation, student and adult interactions, and 
student enthusiasm based upon the student's performance during the first 
month of the school year. Of the 12 students judged by the evaluation team 
as having .demonstrated substantial positive gain in assuming responsibility, 
4 were considered above average in responsibility at the beginning of the 
year (a rating of four or five on the five-point scale), 6 were rated initially 
as average in responsibility (a rating of three) and 2 were rated as below 
average in responsibility (a rating of one or two). In summary, the ability 
to demonstrate growth in responsibility in (CE)2 does not seem to be 
restricted to certain levels of students' initial performance. 

Based ^upon the student staffing records, 8 of the 37 students were judged 
as having demonstrated substantial positive gain in cooperating with the 
project staff, 2 had a decrease in this behavior and insufficient data existed 
to allow a judgment on the remaining 27 students. Of the & students showing 
gain in cooperation, 1 was rated as above average in this area at the 
beginning of the school year, 5 as average and 2 as below average. 

/ 

In terms of improving in interpersonal communications, the data supported 
the view that seven students made substantial gain and one, a decrease. 

Although the concept of enthusiasm was the most difficult of. the four to 
identify in behavioral terms, the student staffing documents suggested that 
seven students made substantial gain and two students, a decrease. Of 
the students showing substantial gain in interpersonal communications and in 
enthusiasnu all were rated as average or below average at the begiiuiing 
of the schoaN^ear. 

Interpretation by the evaluators of student gains in responsibility, cooperation, 
interaction and enthusiasm (based on student staffing documentation) appears 
conservative but basicallj^ consistent with the pre- and postratings made by 
the student coordinator (see page 29 of this report). The student coordinator's 
ratings indicated a gain by 14 students in responsibility, 15 in cooperation, 
19 in interaction and 11 iii enthusiasm. The most noticeable difference 
between the ratings of the student coordinator and those of the evaluators, 
based upon student staffing documentation, is in the area of improved 
student interactions. This is largely accounted for by the fact that student 
staffing documentation contained relatively few comments made systematically 
about individual stucjents in this area. 

For next year, the evaluators recommend that the operations staff attempt 
to make comments on each student regarding each of the areas they would 
like to systematically monitor. 
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student End of Yeiir Questionnaire 
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In May, all (CE)2 and CWE students and a random half of the OSC aiid THS 
random samples completed a Student End of Year Questionnaire, The 
questions dealt with (1) student's future plans, (2) reading interests and 
habits, (3) student's preparation to enter a career, (4) knowledge of job 
trends and related information, and (5) reflections on the school/(CE)2 
experience. The responses to the questionnaire were tabulated for each 
group and are included in Appendix K. ' 

In regard to the student's future plans, 62 percent of (CE)2 students plan 
to continue their formal education beyond high schooL This is less than 
students from the comparison groups (89 percent from THS, 94 percent 
from OSC and 73 percent from CWE), About half of the (CE)2 and CWE 
students plan to be working full time one year after graduation, while only about 
one -fifth of the THS and OSC students plan to be employed full time after 
high school. Twelve percent of the (CE)2 students did not know what they 
would be doing one year hence. This does not differ dramatically from the 
comparison groups which averaged 7 percent undecided, nor did it change 
significantly from the beginning of the year when 15 percent of (CE)2 
students had no future plans. 

Reading interest for all groups increased slightly from the beginning of the 
year. No differential gain between the various groups was evident. The 
number of book? read (excluding textbooks) did not drastically change since 
the beginning of the year nor did the number of students who regularly 
read the newspaper. The front page and comics sections are still the most 
widely read sections of the newspaper by students in both the experimental 
and comparison groups. 

The next set of questions dealt with the student's preparation to enter a 
career of his/her choice. When asked how sure they were of steps to 
prepare for and enter each of the two jobs that they had expressed an 
interest in, 73 percent of the (CE)2 students and 74 percent of the OSC 
students indicated ibat the steps were clrar. Fifty percent of the THS 
students and 53 percent of the CWE students expressed the same degree of 
clarity about career entry procedures. Eighty-seven percent or more of 
the students in each group felt they would be able to complete the necessary 
steps for at least one of the jobs* Fewer (CE)2 students (65 percent) 
considered what they want ont of a job as the first step in career planning 
than the comparison students (about 74 percent). More (CE)2 students 
(62 percent) were^^kU:o accurately describe the future' job market 
(Question 13) than the comparison group students (39 percent of THS, 
52 percent of OSC and 47 percent of CWE). 

Questions 14 through 22 were questions used in the American College 
Testing (ACT) Career Planning Program. They all dealt with knowledge 
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of career planning. While variation existed among the groups on many of 
the questions, there were no overall significant differences on the total 
eight questions. 

Questions 23 through 29 asked the students to reflect Upon their year's 
experience* (CE)2 students _were most like the OSC s|uaents in that they 
felt their experiences were helpful in aiding their understanding themselves, 
their thinking about future work plans and their preparation for future 
learning, and that they had control in planning and carrying out their 
learning experiences. They were quite -different from the OSC students and 
from the other comparison group students, however, in that (CE)2 students 
indicated that they had reflected more on the school experiences this year 
than had the other students. 

^ CASE STUDY SUMMARY 



Purpose 

Case studies* of , two (Ce\2 students were prepared as a part of the evaluation 
activities this year. Tiie purposes of the case studies were to give the 
reader insights into the (C^)^ program that could not be gleaned from 
quantitative group data and to\explore the limits of case study methodology 
using file data supplemented by\interviews with the two students. 

Selection Criteria 

Three criteria were used to select stu^^nts for the case study^^ The first 
criterion specified that one member of each sex be represented. The 
second criterion required that both students be at least moderately successful 
in the (CE)2 program. ' This was done to insure that the case study describe 
actual student-program interaction. Description of an inactive or 
unsuccessful student would not significantly add to knowledge of how tlie 
(CE)2 program operates. The final criterion required that one student be 
a juniojc and one be a senior. 

Procedure 

File data were collected on two {CE)2 students, one, whom we shall cair 
Kari, who was in the program for a year and a half and who graduated; and one, 
Mke, who spent one year in (CE)2 as a junior. These data (Including 
test scores, ^^'^estionnaires, student projects and resulting products, and 
other performance records) were analyzed and organized by a member of the 
evaluation team. Charts were then prepared to show the chronological 



For the complete case study write-up, see Appendix N. Assistance in the 

writing of these case studies was provided by two consultants, 

Ms. Corky Kirkpatrick and Marshall Herron. 64 



sequence of activities of each student during the school year. These 
activities, together with background and test data, were then organized in ^ 
narrative form. 

Copies of tlie draft case studies were given to the two students, who were 
asked to read them and verify their accuracy. Intervie\ys with the two 
students were then conducted to fill in any gaps in information and to 
provide more of the human element that file data did not contain 4 

Content 

Each case study included a description of the background of the student, 
why the student entered the (CE)2 program, activities and progress while 
in the program and student reactions to (CE)2. 

Mike began the (CE)2 school year with low self-confidence, deficiencies 

in reading and communications skills, and above average ability and interest 

in math. His long range goal was to become a comjiuter operator. 

Mike^s early (CE)2 experiences were marked by tarcliness and lack of 
commitment. He did not apply himself well at an qlementary school 
where he worked for three and one-half months. D,uring the second semester, 
however, he had the opportunity to work at a local ;bank where he dealt 
firsthand with computers and computer programming. His attitude and 
performance changed markedly. His lack of motivation and punctuality 
disappeared. He read about computers and workecj closely with his employer 
instructor. Both his self-confidence and his comifiunications skills improved. 

The Life Skills projects that Mike completed duripg the year were designed 
to alleviate his lack of communications skills and self-confidence, and build 
on his interest in math and technology. His Canadian heritage and German 
ancestry also became the impetus for a project ^n immigration laws and a ^ 
course in German. i 



Mike's big accomplishments for the year includefd a strengthened interest / 
in computer technology and determination to find a career in that area, * 
His personal appearance and self-confidence improved greatly and he reports 
with pride that he can now speak up in groups. And, while prior to (CE)2 
Mike never did unr^equired reading but found TV his favorite pasttime, he 
reports that he read eight books this past summer and has begun a hobby of 
collecting copaputer books and materials. ,v 



Kari, an above average student at Tigard High School, entered {CE)^ 
primarily because shp saw the traditional high school curriculum as 
irrelevant. Despite jtopposition by her parents and friends, she was 
determined to try the (CE)2 alternative. 
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Kari's initial experiences in the program fulfilled her worst expectations. 
She was bored by the initial inactivity and- frustrated by the often detailed 
requirements of the program. She remained critical of many of the 
requirements of the program (including the exploration level, the exploration 
package and the mechanics of competency certification) although she finished 
all requirements for the first year and returned for the second despite 
parental pressure to return to a more traditional high school setting. Her 
parents felt the program needed more organization. 

Her second year at (CE)2 was marked by fluctuations both in her mood 
and performance. She began the year with enthusiasm and completed seven 
projects during the fall semester. At midyear, however, she again became 
disenchanted with what she was doing and her productivity dropped off. A 
noncommittal attitude and lack of follow through on her commitments were 
observed by the staff. A number of staff counseling sessions were held 
with her to help her better cope with various changes in her life. By 
February she had regained her excitement and became heavily involved in 
her learning level experiences. 

Kari's big accomplishment at (CE)2 was her ''growing up." Both she and 
the staff recognized in retrospect that her ups and downs were symptoms 
of the normal transition from teenager to adulthood. They feel that she 
made the 'transition well. Kari's second major accomplishment was a 
decision abo&t a career. At the beginning of her senior year she was 
undecided about further education beyond high school but her exploration 
and learning level experiences solidified in her mind her interest in 
secretarial work and in work as a telephone operator. After completing 
her (CE)2 program requirements in early May she began a permanent 
position witli the phone company as a telephone operator, a position she had 
worked at on one of her learning level experiences. 
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IV. FORMATIVE EVALUATION 



Introduction 

Formative evaluation is defined both by the nature of the data collected and 
the use to which the data will be put. Specifically, formative evaluation is 
considered^ a mechanism for providing feedback on program operations to 
appropriate decision makers • 

The original formative evaluation plan was keyed to the milestone events 
and decision points projected in the FY 74 Operating Plan, * The plan 
anticipated that the provision of feedback by evaluation staff would occur in 
both "process monitoring" and "analytic" modes. The process monitoring 
mode was simply the task of keeping track of those milestone events due, 
complete or past due. As the year progressed, it became more efficient 
for the program administrative assistant to assume process monitoring 
responsibility. Progress on major milestone events is now routinely 
monitored an.d summarized in each quarterly report. 

The "analytic" function of formative evaluation occurs in two ways. First, 
a specific set of evaluation questions was generated around the goals and 
objectives stated under each major component in th^ management plan 
(e,g,,. Management, Governance, Instructional System, etc.). These 
questions represented the attempt of program evaluators and the program 
management team to project management information needs over the program 
year. This list of potentially useful questions was carefully examined and 
prioritized by the program management team, and a final list of questions 
specified. The major thrust of formative evaluation activity has been 
directed to collecting information that speaks to these questions and to 
reporting this information at intervals that coincide with the timing of 
major program 'decision points. 

The second way formative evaluation functions is in response to special 
requests from program administration for unanticipated data needs. 

The information gathered by evaluation staff for formative evaluation purposes 
is summarized below. Data were collected primarily from (eE)2 records; 
staff, student, employer or parent questionnaires; and interviews with staff, 
students or employers. Information gathered about each of the questions 



* FY 74 Operating Plan for the Employer-Based Career Education Program , 
NWREL, Portland, Oregon: July, 1973, 



contained in the FY 74 Evaluation Plan* is presented, organized according 
to the components defined by the Operating Plan. 

Management 

1. What is the nature of the decisions made by the (CE) 5> Board over 
the 1973-74 school year? 



A content analysis was made of the minutes of the . (CE)2 9oard of 
Directors meetings of August 1973 through May 1974. The evaluators 
categorized the 70 agenda entries as information items, policy decisions 
or suggestions (see Table 17). Several policy decisions were made at all 
Board meetings but one. Most policy decisions related to changes in Board 
\ membership, the Bylaws or Articles of Incorporation, the subcontract vdth 
the Laboratory and student policies. The types of policy decisions made 
are listed by frequency in Table 17. 



Tabic 17 

CONTENT ANALYSIS OF (CE)2 nOAKO MINUTES 
FOR AUGUST L973 THROUGH MAY 1974 



Meeting 
Date 


Typo of Agcmia Item Entry 


'I'otal 


Information 


l^olicy Decisions 


Suggo.stions 


August 


15 


3 


2 


20 


September 


2 


5 


1 ^ 




Octobe r 


5 






8 


November 


2 


3 




5 


December 


6 " 






6 


January 


5 


1 




C 


February 


5 


1 




G 


March 




2 


i 


G 


April 


No me 


cting held 






May 




I 


1 


5 


Total 




H) 


1^5 


70 



* Consolidated Formative and Summative Evaluation J^lan/* an attachment 
to the FY 74 Operating Plan for the Employer-Based Career Education 
Program , NWEEL, Portland, Oregon; July, 1973, 
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Table 1^ 

CONTEN^r ANALYSIS OF (CEjg BOAj?D MINUTES 
BY TYPES OF POLK'Y DECISIONS JVIADE 



Type of Policy Decision 


Frequency 


Change in Board membership 


5 


Change in Byj.iws or Articles of Incorporation' 


^ r 4 


Subcontract with the Laboratory 


2 


ciiange in a program requirement for stucJonts 


1 


Approval of a student work-for-pay policy 


1 


Cost of living adjustments for staff 


1 


Mileage reimbursement rate for staff 


I 


Approval of Tigard School District Study C{)nimittee 


L 


Student nembership'for FY 75 


1 

I 


Staff salai7 


1 



How effective were recruitment procedures for the 1974-75 school year ? 

The goals of the recruitment procQdures fo.r the 1974-75 school year 
included solicitation of applications from enough students to fill program 
vacancies and control group requirements* In all, 75 studDnt applications 
were sought* Attempts were made to i^ecruit students with a mdc 
range of abilities and aspii^ations to accurately represent a cross 
section of high school studients* 

/ 

Briefly, the following procedures were ^employed. 

/ \^ 

1. Contact was made with the school .district and high school staff 
to explain the goals of the recruitment activity and obtain their 
cooperation and approval. 

1 

2* On April 24 and 2^ a {CE)2 staff member and two or more (CE)2 
students visited all sophomore and junior classrooms at Tigard 
High School. They explained the (CE)2 program "components, 
answered student questions, presented 10-minute slide show 
and passed out applications to .interested students* 
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3, A letter was sent to the parents of all Tigard High School 
sophomores and juniors explaining the program and inviting 
them to an evening open house at the (CE)2 learning center, 

4, On May 7, 1974, an open house was held for the parents of 
prospective (CE)2 students; A presentation by the (CE)2 staff, 

a panel discussion by employers, Board members and staff, and 
a question-answer period made up the agenda. Approximately 
65 adults and 50 students attended the meeting. 

5* On May 15, 1974, (CE)2 students for the 1974-75 school year 
were selected. Of the 87 students who applied to the program 
15 were considered highly motivated students and. guaranteed 
, admission into the program. (The highly motivated students 
were admitted to counterbalance the disproportionate number of 
returning (CE)2 students judged to be low in motivation.) The 
remaining 72 students in the applicant pool were then randomly 
assigned (by means of a random number table) to experimental 
or control group. Upon completion, 30 studepts^ere added to 
the experimental group and 42 to the cont:^r jroup. 

A comparison of available transcript data of the student applicants 
including data from the program students from the 1973-74 school year 
and data from a random sample of Tigard High School students from 
the 1973-74 school year is .summarized in Table 19. The . grade point 
averages are cumulative and include up to the last year the student was 
in Tigard High School. Both juniors and seniors are included in each 
sample. 



Tabic Vi 

SUMMARTV' OF THANSCIUPT DATA (JN 
1073-71 AND 1971-75 (CE)2 Al»PL!CANr,S AKI) 
J07.1'7.'i TKJAIU) niGH SCII(X)I UAiNlKiM ^w^MP^K 



Group 


Grade Vmtx^ A^oraRo nn ? SCAT ^^coroH 


Point 
Average 


Vcrim * .Quanliuitive 




(CK)2 X 
AppUcanl«s • S 
N 


2.50 - 

hZ 


no, 20 
D.20 

no 


I 

(7. HO 
10. SO 

i>0 


•10. 10 

10.10 

f>0 


U»73-7'l X 
(CE)2 S 
.StudentK N 


2. U 

.or, 


'Ipj.90 

tl\ 


M.70 

K. fiO 

:n 


8. 10 
31 


THS X 
Sample .V 


.7.i 
70 


(.3 , 


» 51,. 10 
iiU 


51.00 
Jl.OH 



The data indicate the (CE)2 applicants' GPA and School *and College 
Achievement Test (SCAT) averages are above those of last year's students 
and slightly below the scores of the Tigard High School random -sample. It 
appears, then, that the recruitment goal (at least 75 applicants with a wide 
range of abilities) was adequately met. 

/ 

A questionnaire was sent to a sample of THS students who did not 
apply to (CE)2 to determine why they were not interested in the 
program* Three primary conce.ms (voiced in 40 percent or more of 
the respondents) were that they did not want to leave their friends at 
the high school, they were concerned that (CE)2 might not properly 
prepare them for college and they preferred the type of education 
given at THS* Another concern, expressed by 33 percent of the , 
students, was that they were not really sure what they would be 
required to do in the (CE)2 program. 

Students indicated that most parents' reactions to the program were 
neither positive nor negative (58 percent), 10 percent encouraged the 
student to join the program and 19 percent were against the student^s 
joining. ^ 

When asked what changes would have to be made in a career education 
program to interest the student in joining, 33 percent said the program 
would never interest them. Changes suggested included more information 
(13 percent), more structure in the program (15 percent)^^nd assurances 
that the program would not adversely affect performance in college 
(10 percent). 

Sixty-eight percent of the students in the sample planned to continue 
their education in some way beyond high school. Fifteen percent of 
the'^ students planned to work full time and 26 percent pjanned part- 
time work. Eight percent had no idea of what they would be doing 
after high school. 

How many and what kinds of contacts have occurred b e tween (CE) 2 
and other educational institutions ? 

At the request of Tigard School District 23J, the Oregon Board of 
Education (OBE) has designated (CE)2 a Pilot Program for the school 
years 1973-74 and 1974-75. With.. this- designation, the OBE has 
waived certain standards for operation of the program. 

In accordance with the Oregon statute allowing a school system to 
subcontract services, Tigard School District and (CE)2 have signed a 
letter of agreement outlining responsibilities for the recruitment of 
students, inspection of high school records and testing of high school 
students for evaluation purposes, tlie cataloguing of community. 
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resources, and a study of the feasibility of Tigard School District's 
support of (CE)2 after federal funding ceases. . 

(CE)2 is in contact with the Washington County Intermediate Education 
District for the purpose of providing that district information about, 
and ready access to, {CE)2» 

Numerous contacts are occurring between Tigard School District 
administrators/counselors and (CE)2 staff regarding student transfers 
between, the two institutions at semester break. 

Through an informal agreement with Portland State University (PSU), 
(CE)2 is utilizing volunteer PSU graduate students in certifying 
physical education competencies. 

(CE)2 is a member of the local chamber of commerce. 

(CE)2 is a member of the Oregon Community Education Association, 
an organization which encourages community involvement in the 
educational process. 

Employer Involvement 

4, How satisfied were students with the varioug employer sites ? 

The i)rimary data source for this question is the '^Student Evaluation 
of Learning Level Site'' forms filled out by students placed on learning 
levels. In response to the question "Are you satisfied with your 
present learning site?" 97 percent of the students responded "yes," 
Only 3 percent of the students indicated dissatisfaction. No noticeable 
pattern or type of employer site (such as size or type of occupation) 
emerged as the source of the dissatisfaction. 

5. Is information fed back to, and is it useful to, employers ? 

Sixty of the 90 questionnaires sent to employers were returned. 
Forty-seven of the 60 responded to the question, "Do you receive 
adequate feedback about what happens to students when they leave 
your site?" Their responses are summarized as follows: 

Never Always 
[1 2 3 " 4 6J 

17 14 ' 10 2 4 Total: 47, employe 

ansv/^ring 



Forty-nine employers responded to the question, "Do you receive 
adequate feedback about the effectiveness of your work with students?" 
Their responses are summarized as follows: 

Never Always 
LI 2 I 3 4_ 5J 

9 18 8 6 8 Total: 49 employers 

answering 

All "4" and "5" responses may be combined as an indication of the 
number of employer instructors who felt that they receive adequate 
feedback at least most of the time. In this case, 12 percent of the 
responding employer instructors felt they received adequate feedback 
about student activities away from their site. Twenty-eight percent 
felt they had enough feedback about their own effectiveness with 
students. Next year more frequent contacts are scheduled between 
the employer relations specialists and the employer instructors. 

How many active employer sites from FY 73 remained as active sites 
in FY 74 and how many new sites were added ? ^ / 

As of March 1974, there were 87 employer sites. available to (CE)2 
students. Forty-six of these were also used during the previous 
school year. Forty-one new sites were added. During the 1972-73/ 
school year, 94 employer sites were available to students. A survey 
of the resons given why 19 of these employers declined further 
participation is summarized in TAble 20. 



Table 2o 

REASONS WIIY SOME EMPLOYERS DECLINED 
FUUTlIEa PAUTICIPATIUi^J IN (CE)2 



Reason 


1 

Number 


Operation was too small for partJcipation 


. C 


No time or resources to continue 


5 


Not receptive to the EDGE concept 


3 


Participating in other school programs 


2 


Too hazardous for students 


I 


Didn't like the students 


I 


Unpopular with students 


I 



73 



How many occupational areas were represented by participating 
employers in FY 74 ? 

For the purposes of this analysis, "participating^' employers means 
those employers who have actually had students on their preinises 
this current school year. This designation applies to 87 employer, 
sites. Following are the number of participating employer sites in' 
each of the main categories of the Standard Industrial Classification * 
system* 

Tabic 21 

PAKTICJPATING (CE)2 EMPLOYER SITES 
CIJ\SSIFIED BY THE 
. STANDARD INDUSTRIAL CLASSIFICATION SYSTEM 



Classification ^ 


No. of Sites 


Agriculture, Forestry and Fishing 


I 


Construction 


3 


Finance, Insurance and Real Eijlate 


2 


Manufacturing 


7 


Mining 


0 


Public Administration 


8 


Retail Trade 


17 


Services 


44 


Transportation, Communications, Electric, 
Gas and Sanitary Services 


5 


Wholesale Trade I 

\ 


0 


ToUil 


87 



9 



The number of employers in each category is approximately the same 
as last year. The only exception is the Manufacturing category where 
a decline is evident. Last year, 14 out of 94 employers were 
manufacturers* This year only 7 out of 87 were in that category. 



Standard Industrial Classification system classifies business by types. 
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8, How valuable were the learning experiences at the various sites ? 

In i:esponse to a question on the ^'Student Evaluation of Learning Level 
Site" form which asked "Are you gaining valuable learning experiences?" 
90 percent of the students responded "yes," 8 percent replied "somewhat," 
and 2 percent said 'ho. " No consistent pattern emerged among the 
employers who elicited a "somewhat" or "no" response. 

9. How many exploration, learning and skill buiMing experiences have 
students been involved in at the various employer sites ? 

Records at (CE)2 indicate that students were involved in 201 exploration 
and 90 learning level experiences this year. Table 22 illustrates how 
these experiences are distributed across the 13 Occupational Outlook 
Handbook classifications. Because data in the record l^ooks did not 
always specify which occupation the student was exploring at a particular 
site, 29 exploration and 25 learning level sites were not classified 
(see category 14). 



Tabic 22 



NUMBER OK ^CK»2 KXIM.Ollx\'riON AKi) LKAHNflKO PKACEMKNTS 
BY oCCTPAnoNAI, Ol ri/)OK IIAKI)Il(K)K CDXSSIFICATIONS 



1 KxpIoraUon 



( I. Induslr-il Pr^xluclion arvl Itolatrd 
Oct up.U{nn8i 

; 2. Office f)ccupation5? ' 

Senico (KrupatioH'^ 

4, Education an<i llelate*! tK'< upnttionh 
I 5. SaloN {JccuiMiUonH 

6, Cormlr'icUmi OctupaUons 

j 7. <Jccupai!ont In i'ransportatlDn 

j AollvUioy 

I «. .SclontfHc arKi Trrhniral o< cup itttyiiv. 

\K MrckmU^ ana lUpalnncii 

10. Ilcallh (Xnupatfons 

11. Social Scionti^t^ 

12. SoMaJ Service Occupationrt 

13. Art. Design and (V)mmuntrations 
Hchud Occupations 



M. Not dassificd 



2h 
in 



Total 



U 
It 

n 



Uarning 

'J 
12 



26 
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. The Occupational Outlook Handbook olassification system was used 
because (1) it is comprehensive and {i) its design, with an' alphabetized 
listing of occupations, provides a reliable classification scheme. 

Community Relations/Staffing 

10. How many general information presentations have been made by (CE) ^^ 
staff and to what kinds of audiences? 

The list of formal presentations made to different groups through 
April 1974 is presented in Table 23. 

Tabic 23 

FORMAL INFORMATION PRESENTATIONS 
MADE BY THfe (CE)2 STAFF 



Organization ^ 


Date 


National School Boards Association ^ 


October IS, 19, 1973 


Tigard Rotary Club 


November 8, 1973 


Oregon School Boards Association 


November 16, 1973 


Southwestern Metropolitan Ghambor of Cummeroe 


November 20, 1973 


Chief state School Officers, NWUEL Region 


December 12, 1973 


Model n E valuators and NIE Evaluation Coordinator 


December 17-19, 1973 


Tigard Parent Teacher Student .Association 


January 17, 1974 


Oregon Association for Supervision and 
Curriculum Development (Lincoln City) 


January 18, 19, 197-1 


* 

Washington County Central Labor Council 


January 21, 197*1 


Tektronix Middle Managers 


January 22, 1974 


Oregon School Administrators . ^ 


February 4-5, 1974 


Washington Association for Supervision and 
Curriculum Development (Spokane) 


February 8, 1974 


Oregon State University Extension ' 


February 15, 1974 


SW Chamber of Commerce 


March 5, 1974 


National School Boards Association (Houston) 


April 7-8. 1074 


Tigard Optimists 


April II, 1974 


Northwest State Directors of VocnUonal Education 


y\pril 19, 1974 
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In addition to these presentations a variety of visitors, including local 
teachers and school administrators, local community people, state 
departments of education personnel, NIE visitors, R&D lab personnel, 
employers and labor union rcpresenlatives haye. observed (CE)2 and 
interacted with staff and students. Detailed records of infoi*mal 
presentations to such audiences have not been kept. The above list 
does not include replication presentations to potential adopters of EBCE 
held under the auspices of NWREL. These occurred throughout the 
summer of 1974. ^ 

11. How do (CE )9. staff utilize their time ? 

(CE)2 staff members were asked to fill in .a weekly schedule that 
would represent a "typical" week of activities from the course of the 
year. Although about 30 percent of the staff time is spent on 
developmental activities, as contrasted to program operations, staff 
members were asked to fill in the schedule with ''operations" 
activities only. This was done to obtain a clearer picture of how 
"''an operations staff might work full time with the program. 

The various activities were categorized into five groups and summarized' 
by staff position in Table 24. 



SI'MMAIIY OF Til K PKHCKNT (»l <( i:»2 STAFF HMK 
DKVoTE!) TO VAKIoFS n'PFS i)h AcnVITIES 



Staff Position 


AdminiKtrAtive 


Intcrm lioni* 
With ^U(( 


Working; WiUi 
Students* 


Interactions 

WitJi 
Comimmltj 
People** 


Hec'ord Iveepin^ i 
and Preparing 

Student 

Materials 


Project Director 






t 






Learning Managers 




!} 




to 


33 


EmpJoyor Holatlons Specialists 




10 




U2 


30 


Learning Resource Specialist 




lo 




2H 


19 


Student Coordinator 






Hol Avnilnide 

1 





* Includes Student 'Staff Conferences 
includes Student^ Pa rent/Staff Conf^-rerees 
Percentage of weekly time 



Data are presented for all staff positions except that of student 

coordinator who, because of variations in day-to-day and week-to- »'/eek 
activities, was unable to produce a ''typical" week. 
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Instructional System 

V / 
12. Is the Student Accountabiiity System functioning effectively in terms 
of utilization, follow through and results ? ^ 

.The Student Accountability System consists of a list of responsibilities 
for which students are held accountable and a specified sequence of 
consequences which follow if these responsibilities are not discharged. 
The responsibilities are divided s6 that. (1) students have a variety of 
"options"''available to them, (2) some program requirements are 
considered ''important, " and (3) certain" program requirements are 
defined as "crucial/' These categories encbmpass a broad range of 
student obligations, from negotiating learning experiences under the 
"options" category to keeping appointments with employers and obeying 
the law under the ^crucial" category. 

In fact, the responsibilities listed are so broad in their coverage that 
the effectiveness of tte accountability system is closely tied to the 
operational ejffectivensss of the program as a whole. In this regard, 
the reader is referred to relevant data presented elsewhere in this 
report which summarize such things as the number of projects 
completed in each Life Skills area (Table 30, p. 89), the number of 
students completing each competency (Table 7, p. 31) or the composite 
summary of staff, parent, student and employer judgments of the 
program's effectiveness in accomplishing 15 student learnings 
(Table 8, p. 47). The discussion presented here will be limited to 
data such as accountability-related comments of staff and students; 
estimates of the extent to which students have discharged certain 
responsibilities listed in the system; and a summary of the frequency 
of I consequences defined by the- system* 

Among staff members, seven out of eight rated the accountability 
system as highly necessary. In their judgment of how effectively 
the system had been implemented, however, they averaged only 2.8 
on a scale from one to five. 

Students were mostly positive in their responses. In answer to the 
question, "Are the procedures used by the staff to get students to 
complete program requirements (such as journals or projects) working 
okay," all 14 of the sampled students interviewed said "yes." Some 
went further to comment that they thought some kihd of an accountability 
system was necessary, that tliey felt things were handled fairly, and 
that they had no particular objections to the way tlie system was being 
implemented. 



A significant source of employer comment on responsibility evidenced 
by students on their sites is the Student Performance Review Form. 
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At least one performance review is completed by employer Instructors 
for each student on a learning level experience at their site. Student 
performance on each of 22 criteria is rated as "needing to improve," 
"improving," "satisfactory," "comme'ndable," or "excellent." 
Table 25 summarizes the percent of employer responses of satisfactory, 
commendable or exc^Ugjit totalled oyer all exit performance reviews 
done by employer instruc^c^^this year. 

_ EMPLOYER INSTRUCTOR J^aVeNGS OF STUDENTS 

COMPLETING LEARNING LEVEL EXPERIENCES (N=63) ^ 



student Behavior 


Employer Rating* 






Reports to employer site on timey 


8G 


Adheres to established schedule ' 


75 


Attitude 




Understands and accepts responsibility 


77 


Observes employer's rules 


94 


Shows interest and enthusiasm 


87 


Courteous, cooperative 


97 ' 


Good team worker 


95 


Judgment 


8o 


Poise; self-confidence 


81 


Demonstrates appropriate dress/grooming 


92 


Concerned for equipment/property 

- 


97 


Learning Process 




Uses initiative; seeks opportunities to learn 


' 73 


Learning growth 


85 


Quality of assigned projects 


93 


Asks questions of appropriate person 


91 


Uses employer-site learning resources 


92 


Performance 




Begins assigned tasks promptly 


79 


Seeks feedback concerning performance 


82 


Accepts feedback information 


91 


Uses criticism constructively 


88 


Completes tasks assigned 


88 


Progressively requires Ijjss supervision i 


84 



* Percent of employer instructor ratings of "satisfactory, " '"commendable" 
or "excellent." 
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students were rated highest in being courteous, cooperative and having 
a concern for equipment/property. They were rated lowest in using 
initiative, adhering to an established schedule and understanding and 
accepting responsibility. 

Figures 4 and 5 summarize student completion of projects and 
competencies—two specific tasks for which ^(CE) 2 students are held 
accountable. These displays contain data only On those students 
enrolled in the program from September to May. Returning seniors 
completed an average of 8.8 projects and 10.6 competencies; hew 
seniors, 8.3 projects and 6.3 competencies; and the juniors, 4.9 projects 
and 5.8 competencies. All students enrolled in the program iov an 
entire yeaV are expected to complete ten projects, and six or seven 
competeAcies. n - * 
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9 10 11 12 13 U 15 
Number of Projects Comploted ^During 1973-74 



Fig. 4. Frequency ciistribution of tlic number of projects completed in 
1973-74. i 
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1 2 3 4 5 6 7 8 9 iq> n 12 13 
Number of Compotenclcs Completed During 1973-74* 

Fig. 5. Frequency distribution of the number of competencies 
completed in 1973-74 . 

♦ KIght returning students completed a total of 2o comptencies 
in 1972-73. Individual completions rangfvl from 1 to 7 in 
1972-73. 

Some student responsibilities— such as establishing reasonable lunch 
hours and selecting transportation — are considered "options*' in that 
their specifics may be negotiated to suit the situation^ Others are 
deemed "important": signing in and out, informing employers and ^ 
staff of schedule changes, showing care for equipment and facilities ^ 
and the like. 

Failure of students to meet responsibility for items listed as 
"Importarit" results in penalties such as denial of use of lounge area, 
having to spend a^ specified amount of time working around the learning 
center, cleaning up the lounge or not being allowed to return to 
employer sites foi' a specified period of time. Repeated neglect of 
expectations considered "important'' results in these items being added 
to the third categor/, "crucial": those behaviors considered absolutely 
critical to a student's forward movement in the program. 

Failure of students to meet commitments classified as "crucial" are 
dealt with in the following ways. First, a staff member confers with 
the student to clarify concerns. A probation period of no more than 
one week is established, during which .the student must accomplish 
agreed upon improvements. All criticisms and agreements are put in 

81 
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writingj If within one week satisfactory improvement has not occurred, 
a conference with a staff member, the parents and the student is held. 
An additional week's probation is granted for action taken on amy 
agreements growing out of that conference^. If adequate impro|;ement 
is still not shown, a conference between the student, staff member, 
parents and the project director is held and on^ of tw^o decisions made. 
Either the student is dropped from the prograir, or an additional amount 
of time is given to allow the student to improve. If all parties are not 
satisfied at the end of this period the student^s involvement in the 
program is terminated. ^ Table 26 summarizes records of actions taken 
in each of these categories as of February 1, 1974. Program staff 
have indicated that additional actions have been taken that we^^e not 
formally recorded. Actions taken during the second semester were not 
meticulously recorded and were not available for. this report* 



Table 26 



SUMMAHY OF ACCOUNTABIim ACTIONS TAKKN WITH (CE)2 STUDENTS 



Problem 



Step 1 

Not completing competencies or journal 

' / 

Poor*atten<huicc 

Not following thi-oufih on tasJcs ov assiKnnients 

Not following through on task$ or assignments 
Not following (CK)2 rules 



Not following through on comniitnionls at job 
sites or not going 



Step 2 

Selling or purchasing drugs 
Irresponsible at job site 
Lack of ^»ffort in the program 

Step n 

Selling or purchasing drugs 



Irresponsible at i61>-^jiU»s 
Poor 'participation 



Action 



IH^adlinc or work schedule of 1/2 hour 
|HT diK\ until Work is made up 
Conference with learning manager or 
student coordinator 
^Set up checkup sche<hUe and or 
contingencies 
Probationary period 
Conference 

Detention time (15 minutcj* each day 
not' signing in or out) 
Conference and ^oh^eonsequences 
designated i 
Probation at job sites 
I,etter liome 

Parent conference 

Parent conference ^ 

Parent conf(;ronce 



T'M) week .suspension 

Si\ week suspension and ffork with 

(h-ug treatment and control ^groups 

One week suspC'nsion 

Asked to leave program (possible 

reinstatement) 



No. of 
Imitances* 



24 

s 

7 

1 

3 



♦ Figures listed were actions recorded only as of Kebruary I, 1974. Accurate figures for the 
second semester were unavailable. 
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Is the student record system sufficiently comprehensive and useful to 
the staff? 



Interviews with operational staff concerning the record keeping system 
elicited terms such as "life line," the "nerve center of the whole 
operation," or "we would be hopelessly lost without it, " In response 
to the question of what forms might pp'ssibly be eliminated without 
disturbing the efficiency of the operation, no staff member felt any 
part of the record keeping system was unnecessary, (Developmental 
work during the summer of 1974 has resulted in extensive consolidation 
of paperwork, ho^yever•) 

In response to the specific request of the project director, evaluation 
s'taff examined the record system (in late November and in early 
February) to determine if specific job skills learned by students 
(e.g., welding, typing, keypunching, etc,) were being systematically 
recorded. The analysis revealed that they were not. Modifications 
were made in the student record portfolio to remedy the problem. A 
section describing the job-related skills and proficiencies acquired 
by (CE)2 students is now a part of ^the student^s permanent records. 

.t 

Are students able to identify and secure resources and materials for 
supporting their learning plans? Where are they getting them ? 

Both staff iind students^ Have indicated that locating and securing 
information and materials has not been difficult. A 14-student random 
sample listed the following sources when they were Interviewed. The 
number of students citing, each resource is given in parentheses arid 
reflects a wide variety of resources. 

1. Talking directly with employers or people in the community (8) 

2. Tigard High School Library (8) 

3. Multnomah County Library (7) — 

4. (CE)2 files or learnin^jv^^ 

.5,^ Portland^tatenJniversify Library (4) 

fi. Tigard Public Library (3) 

7. Picked up directly from employers (2) 

8. Obtained from the learning manager (2) 

9. Bought own books (1) 

10. Lewis and Clark College (1) 

11. Writes to sources (1) . ^ 

How much involvement do students have In setting goals for their own 
learning and for selecting content and designing activities to achieve 
these goals ? 

In the interview sessions, all 14 sampled students were able to 
successfully descrilpe ho^w they identified or selected topics, met with 



the learning manager to add or delete specific objectives and had some 
choice in negotiating, the scope and focus of their projects. All 
students said that they felt they had enough freedom in selecting how 
they were going to go about working on their projects* In answer, to 
the questioiu - '^How much involvement do you feel you have in selecting 
your own learning goals while developing projects/' 11 students said 
"much," 3 said "some" and no one said "none." 

These same feelings are borne out by the responses of the 43 students 
who filled out the Student Opinion Survey. Five questions were asked 
about such things as whether students felt they could progress at their 
own rate and whether they felt they had enough choice ijx deciding how 
they would utilize their time. Responses were overwhelriiingly positive 
on all five questions. Most of the negative comnients referred to the 
amount of choice available to' stud,ents while on the employer sites. 
Exact responses to these questions are discussed in the summative 
evaluation^section of this report (Section III). 

16. What is the procedure for giving students systematic feedback on their 
progress? Is it-effective ? 

The individualized nature of the program provides students with feedback 
in many ways. Journals and projects are critiqued otally and in writing 
by the learning managers. Individual negotiating sessions and other 
meetings are held with staff members. Students receive informal 
' ^ feedback from' employer instructors on their leamii^ sites and are 
given a formal performance rating by these individuals at least twice 
during each learning level experience. 

Four questions asked on the Student Opinion Survey were especially 
relevant to whether shidents. felt^they were getting sufficient feedback. 

Their Tesp^ses "are listed belo\y and indicate that while most students 

feel they are getting adequate feedback, some feci especially at 
employer sites that the feedback is inadequate. ^ 

Yes Neutral No 

* 

1. Do you get enough feedback about how well # 

you are doing in the program? • 30 6 7 

2. . Do most of the employer/resource sites you _ - ^ 

have worked with let you know Kow you're 

progressing? 22 12 9 

3. Did you get clear instructions whea you * 
needed them? 

4. Did the employer tell you when you did a 
. good job? ^ 36 




17. 



What is the procedure for establishing baseline diagnostic information 
about students' ability levels, needs, etc. ? 
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Baseline diagnostic information is gathered by means of student self-- 
analysis, staff interviews, and standardized and locally--dcveloped data 
collection- instruments-. 

Self-Analysis . Students describe themselves in an interview with 
reference to eight specific areas of concerns learning environment, 
favorite subjects, learning alternatives and materials, work 
responsibility, assignment completion, learning stimuli, school 
problems and work objectives. 

The student's self-analysis in terms of these areas is summarized by 
the student coordinator and entered in the Master Record Book. 

Learning Manager Analysis . The learning managers interview the 
students in an attempt to get to know the students in a general way 
and to^ identify overall strengths and weaknesses that might affect their 
functioning in the program. 

The results of the interviews are summarized mostly in terms of 
learning manager subjective judgment. The summaries are recorded 
for each student in the Master Record Book, 

Basic Skills . . Assessment of Basic Skills is done by means of the 
Comprehensive Test of Basic Skills (CTBS). The CTBS yields scores 
in reading ability, language arts, arithmetic and study skills. It is 
administered to all students before the school year begins. The tests 
are scored and thd student coordinator summarizes each student^ s 
scores in' a diagnostic format (i.e., describes his or her strengths 
and weaknesses). 

m 

Life Skills. Criterion-referenced tests modeled after the National 
Assessment instruments have been developed by the (CE)2 staff based 
on program objectives for the Life Skills. For each Life Skills area, 
each student is assessed by the learning manager in an interview 
before the student begins a project in that particular area. 

The criterion-referenced instrunient was not finalized until mid-October. 
Due to tinie constraints, assessment in the Lite^Sjcills was about 
25 percent completed by December 1. It should be noted, however, 
'that each Life Slalls area is assessed for each student as the need for 
information in that area arises (i*e. , a project, is about to be written 
in 'that area). Therefore, until each student has worked on a project 
in each Life Skills area, one would not expect 100 percent of the 
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Life Skills assessment to be completed. The learning managers have 
indicated that they did not find the Life Skills assessment instruments 
sufficiently comprehensive or informative to warrant their continued 
,r use next year. 

Career Development . At the beginning of the school year, all (CE)2" 
students complete the Holland's Self Directed Search . This instrum^ent 
identifies career areas that the student^s' interests and strengths point 
out as areas to be explored* 

A computer terminal on line with Oregon's Occupational Information 
Access System (also known as the Career Information System) is 
available to students. Students use the computer to investigate job 
opportunities and job requirements that correspond to their interests 
and abilities. As students' interests change, the computer is available 
" on a "serve yourself basis to update information. , 

18. How is baseline diagnostic data used in designing learning plans ? 

f\ Discussions with the learning managers indicate that the use of 

baseline diagnostic data has. become an integral part of a process 
identified by staff "as one of the most important and the most effective 
of the learning techniques at their disposal. This is the negotiation 
process by which students and their learning managers come to a 
negotiated agreement about which objectives will or will not be - 
included in a student's project. The student^brings to this negotiation 
session his/her own interests, preferences for learning style, and 
ideas about what he/she needs. The learning manager brings 
knowledge of program requirements, student* s past performance, needs 
of the student" as previously diagnosed, and other professional and 
intuitive judgments concerning the specific needs of a particular ^ 
individual. The negotiating sessions are at the heayt of the 
individualized nature of the (CE)2 program. The '^baseline data*' are 
one of the major sources of data brought into the negotiating sessions. 



19. How many employer seminars we.re held ? 

During the 1973-74 school year, four employer seminars were held. 
On October 31, 1973, Mike Torrey, Personnel Manager of Williams 
Air Control, and Ida Meyers, Personnel Manager of Tektronix, dealt 
with the topic of "procedures for applying for a job." On , 
November 27, 1973, Andy Parnes, a professor of economics from 
San Jose State College, conducted a seniinar using the oil/energy 
crisis as an example oj^ the way economics impacts daily life. The 
, third' seminar was conducted by Bill Moshofsky, Vice-President of 
Georgia Pacific, and Horn Sloan, Personnel Director of Tektronix, 
on January 16, 1974. Thjeir topic was "the changing work ethic. " 
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The fourth seminar was "held on March 27, 1974, and involved a panel 
of community people who discussed the issue of job discrimination and 
commented on some experiences based upon this theme. 

How valuable were they in the perception of the students and staff ? 

Sixteen students were polled in quasi-random fashion just before the 
January 30 'Wednesday student meeting, " (The term quasi-random 
is used here because as many students were polled as evaluators 
could reach before the meeting started. While no structured random 
technique was employed, any (CE)2 student who was present for the 
testing scheduled for the noon meeting had approximately equal 
probability of being polled,) The students were asked to comment on 
'How helpful the seminars are to you, " and then to "grade" their 
usefulness on a scale from one, to three, one being the highest rating. 

The first session on procedures for applying for a job was attended 
by all 16 students; the second on economic influences on daily life 
by 12j, and the third on the changing work ethic by 14 of the 16 students. 
Their ratings ''of the three sessions are contained in Table 27, 

Table 27 



(CE)2 STUDENT RATINGS OF EMPLOltER SEMINAR SESSIONS 



Session 


. Number of- Students IVdfmg Session As: 


Total 


1 ' 


2 


3 


N 


■First Session 


11 


3 


2 


IG 

1 


Second Session 


3 


4 


5 


12 


Third Session 


3 

i ^ 


2 


9 


. 14 



The most commonly voiced criticism of the empToyei: seminars among 
these students was that they *'didn't understand^what the speakers were 
saying." Complaints were directed primarily at the second and third 
sejninars. This feeling of "not understanding what was going on" 
seemed to be the primary factor influencing the ratings summarized 
in Table 27. The fourth seminar wasjiot rated by students,^ - 

20. How much time is spent by employer /community instructors working 
Vith. students ? 

An employer cost study, conducted this spring for (CE)2 by an 
independent contract, which polled a stratified random sample of 
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30 participating employers, reported that the employer spent, on the 
average, 26.9 hours per month working with (CE)2 students.* This 
jEigure Includes exploration and learning level experiences. It might 
also be noted that this figure represents the tinie spent by a 
particular employer with a student and not the time spent by students on 
employer sites* Because a student may work on more than one site 
per month, the actual amount of student-employer instructor contact 
time is probably much greater. A breakdov/n of the employer 
instructors' time by category of task is shown in Table 28. The 
estimated cost per month per student for this instructional time is 
$184.25. Three to five times as many hours were provided by 
employer instructors for sharing information with students on the 
learning level as on the exploration level. No significant time 
differences between exploration and learning leyels were noted for 
other cost areas. Instructional tim'e did not appear to be greatly 
different when the data were examined between production or service 
type businesses or wiien considering the size of the business.** In 
reading Table 28 it should be kept in mind that for a few activities 
such as assistance with written objectives actual time was recorded for 
only 10 of the 30 employers interviewed. It is assumed that the 
remaining employers did not spend time in this activity. 

! 

Table 28 [ 

NUMBER OF HOURS SPENT 
m EMPLOYER PER STUDENT PER MONTH 



Type of Activity 


Number of 
Hours 


Orientation time 


2.8 


Beginning skills coifnseling 


4-. 7 


Assistance with wripen objectives 


4.2 


Attendance certification ^ 


2. 1 \ 


Performance review 


1.4 


Information, sharing 


11.7 



* Turner, C, M. Dryden and J. Thrasher, ''Investigation of Employer 
Costs in Experience-Based Career Education,'' The Institute for 
Educational Management, San Diego, California: April, 1974, p. 86. 

** Ibid., p. 96. 
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21. How many projects were generated for (CE) ^ students How ma ny 
were completed? How many were dropped ? 

Projects generated, completed or dropped in each of the five Life ^ 
Skills areas are summarized by month in Tables 29, 30 and 31. As 
can be seen in Table 29, the learning managers and students generated 
more projects in February and March than they had in the combined ] 
first five months. Substantially more projects were generated in | 
critical thinking than in the -other areas. Correspondingly, in Table 30 1 
only 49 projects had been completed by students prior to February* \ 
Reasons for this slow start included the other demands on learning 
managers' time and the need to gain experience and efficiency in 
developing projects. 'The number of projects completed by students 
per month increased each month of the school year with the single 
exception of February. 'In Table 31 two areas, functional citizenship 
and creative development, show the greatest proportion, of projects 
dropped or not completed. 

Tabic 21) 



PROJECTS GENERATED MONTHLY IN EACH UFE SKIL1.S AREA 





Month 




Life Skills Area 


Sept 


Oct 


Nov 


Dec 1 


Jan 


Feb 


Mar 


Apr 


May 


June 


Total 


Critical Thinking 




10 


6 




1 


IG 


13 


12 


4 


1 


85 


Functional Citizenship 


4 


4 


3 


0 


■ 


4 


18 


20 


8- 


0 


(59 


Personal/Social 
^ Development 


^ 5 


- 7 


5 


0 




20 


17 


8 


6 


0 


69 


Creative Development 


9 


G 


2 


4 


4 


10 


18 


3 


8 


3 


67 


Science 


3 


8 


9 


0 


4 


10 


IG 


9 


1 


0 


69 • 


Totil 


24 


35 


25 


23 


18 


G9 


, H2 
! 


i52 


27 


4 


359 



Table 30 



PROJECTS COMPLETED MONTHLY IN EACH LIFE SKILLS AREA 



Life Skills Area 


Montli 


Total 


Sept 


Oct 


Nov 


Dec 


Jan 


Feb 


Mar 


Apr 


May 


June 


Critical Thinking 


0 


0 


1 


5 


5 


4 


G 


12 


16 


21 


70 


Functional Citizenship 


0 


0 


0 


2 


5 


3 


5 


2 


10 


20 


' 47 


Personal/Social 
























Development 


0 


0 


1 


2 


2 


3 


1 


IG 


14 


18 


57 


Creative Development 


0 


0 


2 


8 


8 


I 


5 


2 


10 


9 


45 


N 








t 
















Science 


0 


. 0 


2 


1 


5 


2 


8 


12 


15 


11 


56 


Total 


0 


0 


6 


18 


25 


13 


25 


44 


65 


79 


275 
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Tabic 31 



'PROJECTS DROPPED OR NOT COMPLETED 
IN EACH LIFE SKILLS AREA 



Life Skills Aren 


Number of Projects Dropped 


Critical Thinking 


15 


Functional Citizenship 


22 


Personal/Social Development 


12 


Creative Development 


22 ' 


Science 


13 


Total 


84 



22* How many competencies were completed by students in the program ? 

For a discussion of th;is question please refer to page 31, Table 7 
in this report. ^ ' ' ' 

23. Plow useful do students and staff perceive each of the learning strategies 
to be ? 

The random group of students interviewed in February was given. a 
list of 14 learning processes and asked to respond to the following 
question: "Here is a sheet showing the various learning processes 
in (GE)2. Let's cross off any that you have not yet used. Please 
take a minute to rate each process as High, Medium or Low in, terms 
of hojv useful you think it is in helping you to learn. As you go 
through the list feel free to comment out loud on any ones you care 
to. " 

The five learning strategies i^eceiving the highest and the five 
receiving the lowest composite ratings by stuplehts are listed in 
Table 32 (means are computed on the basis of a three-point scale; 
High=3, Medium=2, Low=l). 
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/ Table 32 

. STUDEN-/ RATINGS OF LEARNING STR'ATEGIES 



/ 



/ 

Learning^trategies ^ 


Mean 


Highest Ratings 

/ 




/ 

Actual involvement on an employer site 


*\ no 


Working on projects 


2.79 


Counseling groups 


2. 75 


Student retreat " 


2.66 


Employer/community tutors 


2.62 


. Lowest Ratings 




Testing and measurement 


2.00 


.Employer seminars 


1.93 


Exploration package 


1.8C 


Using the computer 


1.80 


Student journals 


1.71 



(CE)2 staff were asked to rate how important certain processes were 
and how effectively they felt the processes had been implemented. 
Learning processes listed on the staff questionnaire were related to 
a list of "handbooks'' to become available this year that describe? the 
parts of. the EBCE program, * Table 33 summarizes staff responses 
to these questions. 
/ ' ' 

Note: Students and staff were not responding to exactly the same 
list. Eleven of the 14 items on the studeht response list matched 
10 of 13 items on the staff response list. Two kinds of group 
activities were listed on the student lists, only one on the staff list. 
Three responses on the student list not listed for staff were ''Using 
the computer," "Actual work on an employer site," and '^Testing 
and measurement." Two responses on the staff list not listed for 
students were "Student accountability system, " and "Learning level 
process. " Those responses on both lists are marked with ah 
asterisk on Table 33. 



* See Appendix Q. 




Table 33 

STAFF RATINGS OF LEARNING STRATEGIES 



/ 

Learning Strategies: 

a. Student Orientation* 



Student Accountability System 



Student Negotiation* 



d. 
e. 
f. 

g- 
h. 
i. 

k. 

L 



Project* 



Journals* 



Competencies* 



Exploration Package* 



liearning Level Process 



learning Level Package* 



Tutors* 



Employer Seminars* 



Group Activities* 



How important 

for (CE)2 Students? 



Not Highly 
Important Impor- 
tant 

1 2 3 4 5 



13 4 



3 4 



1 7 



2 4 1 



3 A 



4 3 



13 4 



2 114 



6 2 



— 232 



How Effectively Has 
. It Been Implemented V 


Mean 

Response 

for 

Effectiveness 


Not , Highly 
Effec- Effec"^ 
tive tive 
1 2 3 4 5 




^ rr-^=^5. — ^2—1- 


' — 375D 


— 3 4 1 — 


2,75 


1—2 1 1 3 


3. 71 


— „ 3 5 — 


3.63 


— 4. 1 3 — 


2.88 


3 4 


3.57 


— 1 4 2 — 


3. 14 


114 1 — 


2.71 


1 3 4 — — 


2,38 


— 5 1 2 — 


2. 63 


2 2 13 — 


2.63 


2 112 — 


2.50 



* These strategies were asked commonly of staff and students. 

Both groups gave relatively high ratings to working on projects and 
relatively low ratings to the employer seminars. Otherwise there 
was little agreement between them. Students gave the lowest ratings 
to the "student journal," next lowest to the "exploration package." 
Both processes were rated relatively high by staff. Conversely, 
'Jtutors" and "group activities" were rated low In effectiveness by 
staff but were named among the five most useful learning processes 
by students. 



24, What is the quality of student projects and resulting products? 



A summary of the technical reviews of projects from each of tlie 
life Skills areas is included in the summative evaluation section — 
Section IE — of this report. The learning managers* evaluation of 
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student products resulting from projects is included within the 
discussions of each Life Skills area in Section m. 

What is the distribution of time students spend at various activities ? 

A sample of 11 students was asked in May to keep a specially coded 
daily log of their activities for- one week. Data were received from 
7 of the 11 students. The total number of days recorded was 35. * 
The average day reported was 6,5 hours long. Figure 6 illustrates 
how students reported their time was spent. 




FiQ. 6. Percent of student time spent ut vonotis octivitios. 



The major change in the average student's day from that reported at 
midyear involves an increase in the amount of time spent at employer 
sites. The midyear proportion of 38 percent increased to 56.5 percent 
by the end of the year. This is due mainly to increased learning 
level activity. One student in tha|sample reported spending a 40 -hour 
week at an employer site. Not displayed on the above chart is the ^ 
fact that .5 percent of the project time wats spent at employer sites 
as well as .5 percent of the Exploration^ackage time and 3 percent 
of the Learning Level Package^time. Because the time allocation 
discussed above is based only upon seven students, the reader should 
be cautious in generalizing from^ it. 



Guidan ce 

26* What system is the (CE) ;? staff using to monitor and record affective 
growth? How effective is the system ? 

The system used to examine change in students* affective behavior is 
known as tlie "student staffing** system. This system and its 
- effectiveness are discussed in Section m of this report (see \p. 59), 

En^ployer/Community Utilization 

27, How many training/orientation sessions for employers have been held? 
Who cfame? How effective did employers feel these sessions were ? 

Orientation sessions (two ''identical** meetings held on consecutive 
. nights) were held for employers in October, No evaluation was done 
on the orientation sessions, A problem solving clinic (again, two 
sessions on consecutive^ nights) followed in early December, An 
evaluation of the problem solving clinic was conducted that attempted 
to determine the clinic's impact on employers and to identify employer 
suggestions for improving future sessions, A formative evaluation 
report was submitted to program management oh January 16, 1974, 
Following is a brief summary of that report. 

Observations of the two evaluators attending the clinics indicated that 
the presentations on both nights were exceptionally well-organized and 
presented, A questioimaire was .distributed to each participant at the 
end of the sessions, ' Of the 42 participants attending the sessions, 
25 completed the questionnaire for a 60 percent respo»se rate. 
Because questionriaires were anonymous a followup was not conducted 
to increase this response rate. 

Responses on the questionnaire were predominantly positive with the 
highest rating given to the program staff's willingness to respond to 
participants' questions. Lowest ratings were given on pfirticipants* 
understanding of the student learning system. Twenty-four of the 25 
participants indicated that they felt the program's expectations for 
participatmg employers were realistic and all respondents felt that a 
weekly site visit by the employer relations specialist was sufficient 
to maintain communications. The most frequently cited observations of 
student changes involved students becoming more interested in a 
particular job or improving work-related behaviors such as punctuality. 

Respondents indicated an interest in having future seminars address the 
areas pf helping students reach their objectives, judging student 
performance and introducing a student to the "real world of work,*' 
including the training needed for it* 




On March 14, 1974, a third session,; attended, bjf 46 e 
representing 34 sites, ^was convened. ^^The^'^session emphasized the 
(CE)2 program's orientation »toJb€t learning p/jbcess-* Smrall group 
discussion topics included VwayS^I hoping and encouraging students 
" on job sites," "judging performance oA-job sites, "f and '"helping 
stud^ts^fd learn more abcAit thByWorld ot work arid training needed 
for specific jobs." . ' * ' ' ^ * * 

On June 4, 1974, a^ fourth session was held to receive employer 
. evaluation and feedback. ^ Approximately 50 employers attended. 
Topics discussed^in depth included explorations, learning levels and 
the competencies.^ * . ' 

- ~ . ^ 1/ ' ' • ' • 

No Vsfematic/ evaluation was done on th^ Ma'tch and June sessipAS,* 
The continued; a^endance of a large number of employers at all the 
sessions however is another indication that the employers perceived 
' the , sessions jas useful, * • 

.28, Is the Learning Site Analysis Form effective in identifying, applied 
Basic Skills needed at employer sites ? \ { ^ ^ 

The Learning Site Analysis Form (LSAF), in addition to pi:o>idin^an 
effective system for identifying Basic SlAlls potential of ]6h sitea,^,- 
has produced additional positive side effects. Thq manner in which 
the jieaming site analysis is conducted requires the employer relations 
specialist to list major tasks and subtasks for the job being analyzed. 
For each subtask entered on the LSAf/ a judgment is made abo^ its 
' potential iov developing "applied" or "fundamental" Basic Skills in 
mathematics, reading or communications. ^ 

* * 
Employer relations specialists report that many employer instructors 
are pleased* with the amount and degree of detail of information the 
technique digs out and displays about tiieir jobs; It seems to help 
them get better handle on what they do and what is required for 
their Job. « Employers also report that the ISAF procedure is often 
useful in preparing job descriptions and identifying personnel training 
needs at job entry. 

29. To -what extent do employers inform the center when students need ^ 
help in^B'asic Skills? 
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Conversations with the employer relations specialists indicate that 
although employers are capable and willing to point out Basic Skills 
deficiencies, a convenient vehicle for this activity has not existed. 
While several employers contacted the learning center to point out 
Basic Skills deficiencies, it, was the students themselves who most 
often brought out di^repancies between learning site requir^nv.ents 



and their own Basic Skills. A site monitoring mechanisni is planned 
for next year to elicit eniployef s' assessments of Basic Skills 
deficiencies.. , *^ . - ' 

The responses of 53 of the 60 employer instructors returning the 
Employer Opinion Survey at midyear are summarized below, 
Employer^instructors showed a wide variation in describing themselves* 
as either ^ery able" or "not at^all abl^e" to identify: student 
• deficiencies in the Basic* Skills, 

^ Not at ^ Very 

all able - ^ able 
^1 2 3 4 5J 

8 .7 16 14 . 8 Total: 53 responses 

This tendency/ is further borne out in the 14 student interviews conducted 
by evaluation staff in February. Only three students ans.wered "yes" 
to the question, "Have ' employers helped you identify any Basic Skills 
that you need to Wrk oh?" These same three students indicated that 
the employers » went on to provide, help in the areas identified as 
problematic: math (1), spelling (1), and vocabulary recognition (1). 

30. To what extent were students able to explore the career choices they x 
indicated at the Seginning of the year ? ^ 

Data from the Student Opinion Survey, completed by students at 
midyear, indicate that^most students have changed their career interests 
since the beginning of the year. Comparisons reveal only a 17 percent 
overlap between the three career interest areas listed on the February 
questionnaire and the three listed on the Self Directed Search -in 
September. . ' , ^ 

Twelve of 14 students interviewed in February had explored each of 
^ the 3 areas they listed -on -the questionnaire in January. Analysis of 

the end of year questionnaire reveals that slightly over* 75 percent 
of the end of year job aspirations had been explored over the cours*e 
of the year. The employer relations specialists indicated that they 
• have been able to supply emplojyer sites to satisfy all but a few 
requests. In a few cases (interest in, being an airline stewardess, 
for example) actual 'experience has been difficult — if .not impossible — 
to arrange. 

31. What effect, if any, is the evaluation having on changing operations of 

-the project? ' . 
* — " — 

k response to this question is somewhat difficult to make because a 
cause-effect relationship is implied. Seldom has this been the case."^ 
The evaluation team has not uncovered information-4Jiat was unlqiown 



or unsensed by the operations staff. Since the two units have worked 
together closely this year, many of the same issues have been 
examined. What the evaluation team has done has been to systematically 
collect and present data that usually supported the opinion or hunches 
of the operations staff. Armed with these facts and figures the changes 
made by the operations staff were sonietimes easier to explain to 
outsiders. 

Three examples can be given to show the influence of evaluation 
information on changing project operations. On the February staff 
questionn^irejj five of the eight operations staff members stated on 
an open-ended question that the CTBS information on individual students 
was useful. For example, the learning managers use this information 
when they set up' projects for students. In another case, feedback 
provided to program staff concerning th^ student 'background information 
along with pretest data for (CE)2 andK^ random sample of THS students 
showed that many of the (CE)2 students have significantly different . 
characteristics than those at THS. The evaluators provided the program 
staff with empirical data useful in making visitor presentations to 
document areas of similarity and areas of difference between (CE)2 
students and a cross section of THS students. A third example of 
the use of evaluation information by the program staff occurred when 
the evaluators and (CE)2 staff worked together to develop an employer 
training workshop questionnaire. Information from this questionnaire 
was analyzed by the evaluation unit and the feedback of information to 
the (CE)2 staff was considered useful by them^in planning for their 
next employer workshop. ^ 

In addition, evaluation has also influenced developmental operations. 
For example, a questionnaire was developed to obtain from program 
staff and potential adopters their opinions of the importance and timing 
dimension. of a number of projected "handbooks'* describing program 
components. Such feedback allowed product development staff to 
prepare a production timeline to meet the needs of potential adopters 
of EBCE. 

A brief rating scale was also developed in February 1974^or use 
with the Tigard School District EBCE Study Committe^lo assess the 
perceived importance of various kinds of evaluation information to 
potential ^adopters. Members of this groiq) included parents, school 
administrators. Board members and students. This same rating 
* scale was also used with the (CE)2 Board. For an example of how 
the (CE)2 operations staff interpret evaluation data tile reader may* 
•wish to read Appendix I\ 

In addition to evaluation information useful to the program staff and 
special interesjt groups, comparative group information also has beeil 
useful to administrators at the Occupational Skills Center in planning 
future career education activities. 
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Formative Evaluation 

32, How effective is the "decision form" in highlighting information to 
enter' into the documentation ? ' , 

The decision form ^yas developed in September 197^by the product 
development and documentation staff as a way of recording important 
decisions made by individuals or groups within the EBCE program 
that might have impact upon the policies or operations of the program. 
It was also felt that such forms would reduce the amount of staff time 
involved in recording and reviewing minutes from various (CE)2 group 
meetings throughout the year. 

In the judgment of the evaluation team the "decision form" concept 
has merit but has been ineffective in its implementation^ A' check of 
documentation files revealed that only eight decision forms had been 
recorded ' of June 30, 1974, These results were discussed at a 
management meeting and the groiip consensus ^was that this was a low 
priority activity. No solutions were proposed at that time. 

How effective are tlie evaluation instruments being used this year ? 

H 

Shortcomings have been uncovered this year in the ^design, validity 
or 'use of almost all of the instruments employed. This section will 
sketch only a brief summary of some of the major problems encountered 
to serve as an aid to others in research and evaluation. Instruments 
discussed in this section are described in Appendix Av — 

'] 

The instrument that has stirred up the greatest criticism this year 
from students, project staff and evaluators at alLfour EBCE sites, 
hasjbeeh the Career Maturity Inventory , Problems cited in the Tise 
of this instrument in EBCE -projects, include that (1) the majority of 
staff sorveyed at all 4 sites disagree with the "right" answer, as 
stated by the publishers, to 5 or 6 of the 50 items on the Attitude 
Scale; (2) several of the fundamental assumptions behind the test design 
may be appropriate to school-based career education projects but are' 
inappropriate^ to experience-based projects; (3) some of the Attitude 
Scale items have low or negative point biserial correlations with- the 
total scale score thus indicating that they are not measuring a 

^ homogeneous concept; (4) data about the specific items that measure 
the various dimensions claimed to make up the concept of career 
maturity are unavailable from the publishers; (5) the notion of a single 
score to reflect career maturity is rejected by many; (6) the competency 
sections of the test measure general knowledge about a broad range of 
careers whereas the emphasis in (CE)2 is upon students gaining an 
indepth knowledge of those careers of personal interest to^ them; and 
(7) the competency sectipns are highly correlated with^g(?heral aptitude 
measures and thus seem to be ^ore a measure of general intelligence 

* than of career maturity. ' , • 



The Psychosocial Maturity Scale has been useful this year in measuring 
some of the indirect outcome measures of the project such as the 
students' openness to .change, tolerance and willingness to trust others 
when warranted. The major problem encountered in using this 
instrument in September was its length (203 items) which caused many 
students to t)eCome bored with it. By October the evaluation team 
learned from Dr. Gre^riberger, the senior author of the instrument, 
that a 102-item version had been developed recently, making use of 
items selected from the initial 203. The pretests were rescored based 
upon only the items remaining on the shorter form. The short 
version was ^ then administered to alternate students as either a midyear 
or posttest. The brevity of items per scale (approximately 10) 
prevented the individual scales from having high reliability for 
individual students. This caused the developers to regroi^) individual 
scales into three summary scales — individual adequacy, social 
adequacy an;d interpersonal communications. 

The major problem encountered in the use of the Self Directed Search 
(SDS) was that many (CE)2 students were unable to code and summarize 
their responses correctly. Prior to June 1974, the evaluation team 
was unaware of the multiple^ uses of the SDS for assessing student 
self-understanding. As a re^sult, the instrument was used only for 
diagnosis and was not administered on a posttest basis. In July, 
Dr. Owens spent a day visiting personnel at the Center for Social 
Organization of Schools at Johns Hopkins University who were 
instrumental in the development and refinement of the SDS. New 
ins igjiits- gained from this professional exch'Snge will allow a more 
meaningful analysis of the SDS on. a pre-post basis in 1974-75. . 

Problems encountered in using the student staffing process for program 

...» 

evaluation purposes have already been discussed- in Section HI where 
the results of this process were reported. 

Two locally developed evaluation instruments used with (CE)2 students 
this year have also contained problems. The Newspaper Reading 
Exercise, developed as a criterion measure of a student's ability to 
read sections frofh a local newspaper with understanding, suffered 
from^ a weakness which was also its strength. The newspaper sections 
selected for use were of high interest to students largely because they 
dealt with timely issues such as air pollution. When the same form of 
the test was used as a posttest measure it was not possible to tell 
whether the large gain ^made by students was a function of their 
increased reading ability, increased knowledge of the subject content 
or practice effect from having taken the test four months .earlier. 

The second locally developed instrument presenting problems was the 
Writing Exercise. Although the criteria used to score the Exercise 
had been adequately refined over the past two years, a pjroblem arose 
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when some students provided too short a writing sample. While the 
directions called for over a full page, some students chose to write 
only one oy two sentences. 

The eyaluators have pi^ot tesfed only prototype instruments in other 
areas .directly related to EBCE with .limited success. Further work 
is needed to improve instruments for assessing oral communication, 
the /quality of experiential learning and career development attitudes 
and competencies. 

34. What influence has {CE) o had on. the Tigard School District ? 

The following information was obtained through an informal interview 
in August 1974 with Peter Taylor, Assistant Superintendent of the 
Tigard School District. 

During FY 73 several team members from THS who were setting up 
the schooPs Alternative Futures program got help from the (CE)2 
staff in involving the community iri education. They adapted ideas 
for their program patterned on the (CE)2 Learning Site Analysis Form 
and. the concept of the competencies. ^ The counseling concept in (CE)2 
has also been adapted by the staff at Fowler Junior High School as a 
way of sharing the responsibility across staff members rather than 
centralizing it in only one or two staff members. 

This year sdme of the District staff have found their association with 
research and developpfient people from NWREi and witlr visitors from 
^ other parts of the country, such a^ members of the External Site 
Review Team, to 1)e ^rewarding and informative. Some of the THS 
teachers have mentioned being influenced by the optimism of some 
of the (CE)2 staff in dealing with students often regarded as problem 
cases. For next year the 'Work Release Program at THS is planning 
^to initiate employer seminars patterned after those held by (CE)2. 
They are also intending to use some employer feedback .forms similar 
to those used in (CE)2* Other possible areas in which (CE)2 might 
assist the District in the future, according to Taylor, are in sharing 
Information about employer sites and community resources with other 
career or work experience programs, in serving as a training site 
for educators interested in the process of exploring various careers 
and in learning to^woric more effectively with people in the community. 



V. SUMMARY AND RECOMMENDATIONS 

Introduction 

The quantity and scope' of information contained in this FY 74 end-of-year 
evaluation report makes a brief summary difficult. An attempt will be made, 
however, to highlight the evaluation findings and to suggest reqommendattons. 
References are provided to other sections of this report so that readers 
can*' more easily locate a fuller discussion of results summarized here. 
Another important perspective on findings is contained in Appendix P which 
p^-esents interpretations of evaluation findings by the (CE)2 staff. 

Data contained in this evaluation report .generally cover the period of 
September 1973 to July 1974. This was the second year of operation of 
this EBCE Project called Community Experiences for Career Education, 
(CE)2. Approximately 50 juniors and seniors from Tigard High School 
participated in this project on a full-day basis. Students usually spent 
half of their time at a learning center working witb a professional staff 
of seven and the other half of their time learning at various employer and 
community sites.* • 

Summary of Findings 

Students participating in (CE)2 engaged in a number of individualized activities 
designed to provide meaningful learning experiences in Basic Skills, Life 
Skills and Career Development. Section HI of this report identifies the 
major program goal outcomes, relates the learning processes, designed to 
achieve each outcome, and discusses the findings related to each outcome. 

On the basis of pre- and postadministration of the Comprehensive Test of 
Basic Skills (CTBS), students participating in the (CE)2 program showed 
a statistically significant gain in reading, mathematics and, study skills 
during the year. This is particularly impressive since former (CE)2 
students the prior year averaged no growth on this instrument. No 
significant gain this year was registered by (CE)r2 students on the Language 
Mechanics section of the CTBS. When converted to grade level equivalent 
scores (CE)2 students gained five months in reading, six months in language, 
seven months in arithmetic and a year and a half in study skills. This 
compares to a gain by the THS sample iof two months in reading, a loss 
of four months in language and and one/ month in arithmetic and a gain of 
seven niontlis in study skills. 

* Fop a more complete description of the project, the reader is referred to 
a general information brochure called "Community Experiences for Career 
Education," available free upon request from the Northwest Regional Educational 
Laboratofy. • ' 
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Although statistically lower in Basic Skills at the beginning of the school 
year than a random sample of students enrolled in the regular school program 
at Tigard High School, (CE)2 students gained slightly more in reading, 
arithmetic, language expression and study skills on the CTBS than did this 
comparison groi^). None of these comparative dilEferences in gains was 
statistically significant between the two groups, 

A sample of eight (CE)2 students who^ scored b61ow the ninth grade level on 
the CTBS Reading pretest showed a statistically significant gain when a 
locally developed Newspaper Reading Exercise was administered to them 
in January and again in May* A locally developed writing scale, rated on 
ten criteria, showed no significant growth for (CE)2 students or a comparison 
group between September .and May, 

A semantic differential instrument, designed to measure attitudes toward the 
concepts of "Me," " School " "Adults," " Learning , " 'Work" and " Decision 
Making , " was administered to (CE)2 students in September, at midyear and 
again in May, Students demonstrated a statistically significant growth in all 
six areas during the first half of the year. From midyear to May, however, 
either the rate of change decreased or a slight dr6p was indicated* Over the 
course of the full year, however, statistically sigjlificant growth was still 
maintained for the concepts of "Me," "School," " Learning ^ and ' Decision 
Making s" 

The Psychosocial Maturity Scale was administered to all the (CE)2 students ^. 
and to three comparison groups in the fall. In January, a random half of 
these groups^ completed the instrument again. The rentiaining students 
responded to the instrument in May. .This instrument measures the student's 
self-rating on the following scales: Work, Self-Reliance, Identity, 
Communication, Role, Trust, Social Coifimitment, Tolerance, Openness to 
Change and Social Desirability (which serves "as ali. internal validity scale). 
The first semester change in PSM scores for (CE)2 students was dramatic. 
Scores on all PSM subscales increased significantly with the exception of 
the Work, Identity, Communication and Social Desirability subscales. The 
general pattern oi change on the PSM follows that noted on the Semantic 
Differential. The rather dramatic positive change evidenced during the 
first semester was in part tempered by a slow-down or slight decrease in 
the second semester. Positive change over the entire year (p^etest-postl-est) 
was significant for the Work, Self -Reliance, Communication and Trust 
scales.. The comparative growth, over the year for (CE)2 ^students was not 
significantly greater, however, than that made by several comparison groups. 

The Career Maturity Inventory Attitude Scale was administered to all (CE)2 
students in September and then to a random half in February and a random 
half in May. Change bet\veen pretest and midyear means was slight while 
the change between pretest and posttest was statistically significant. 
Nevertheless, the staff and evaluators feel that this instrument is not valid 
for measuring an EBCE program and do not plan to use it next year. 



The attendance data for (CE)2 students indicated that this year they were 
absent slightly less often than when they attended Tigard High School 
the year prior to their entrance into (CE)2. 

In the life Skills area students completed most of their learning through 
work on individual projects. Seventy projects were completed in critical 
thinking, 56 in science, 45 in creative development, 47 in functional 
citizenship and 57 in personal-social development* Each of these projects 
had individual objectives and criteria that were applied by the learning 
managers in evaluating these projects. The evaluation xmit reviewed the 
written evaluation comments of the learning managers and classified such 
comments into positive, neutral or negative reactions. The percentage of 
favorable .comments ranged from an average of 56 percent for science 
projecjts to 36 percent for functional citizenship projects. All students in 
(CE)2 are expected to engage in activities to improve themselves in critical 
thinking, science, creative development, functional citizenship and personal- 
social development. While an opportunity to do this may be available in 
a regular high school, not all students are expected to interact with each of 
these Life Skills areas. 

Students enrolled in (CE)2 for two years are also required to complete 
thirteen competencies, such as maintaining a checking account in good 
order, to graduate from the program. The percentage of all (CE)2 students 
comple.ting such competencies ranged from 94 percent of the students 
completing the competency on transacting business on a credit basis to 
10 percent of the students completing a competency requiring them to explain 
their own l,egal rights and responsibilities. This indicates student perceptions 
cf the interest, difficulty level or importance of each competency. Students 
averaged completing 5. 6 competencies this year as conq)ared with 3 
competencies the prior year. 

Weekly discussions by the (CE)2 staff regarding observable student behaviors 
have revealed that many students have grown substantially in assuming 
responsibility for their actions and in cooperating with program &taff and 
employer instructors. Substantial growth has been noted also in students' 
ability to communicate effectively wiih adults and with fellow students. 

Case studies* of two (CE)2 students were prepared as a part of the 
evaluation activities this year. The purposes of the case studies were to 
give the reader insights into the (CE)2 program that could not be gleaned 
from quantitative group data and to explore the application of case study 
methodology using file data supplemented by interviews with the two students. 

Copies of the draft case studies, based on over twenty sources of data, were 
given to the t\vo students, who were asked to read them and verify their 



* For the complete ca^se study write-up, see Appendix N. 
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accuracy. Interviews with the two students were then conducted to fill in 
any possible gaps in information and to provide more of the human element 
that file data did not contain. The two case studies, completed on a boy 
who participated in (CE)2 for his junior year and a girl who graduated in 
June after spending a year and a half in the program, revealed some 
interesting insights. Each case study included a description of the background 
of the student, why he or she entered the (CE)2 program, activities and 
progress while in the program and student reactions to (CE)2. 

The extent to which the, employer instructors and project staff got to know 
the student as a person, built upon his or her interests and encouraged the 
student to live up to his or her potential, are revealed in these case 
studies. Likewise, the case studies show the anxieties, struggles, 
frustrations and personal growth of two young people as they progressed 
through (CE)2. 

At the end of the school year (CE)2 students and those from three comparison 
groups fa random sample from' Tigard High School (THS), a sample from the 
Occupational Skills Center (OSC) in a neighboring school district and students 
in the Diversified Occupational Cluster of the THS Cooperative Work 
Experience (CWE) Program) were asked to complete a questionnaire 
containing some items related to their feelings about their year's educational 
experience. Students were asked to rate how helpful they felt their 
school/(CE)2 experiences this year had been in allowing them to understand 
more about themselves. On a scale ranging from one (of little or no help) 
to five (very helpful), 46 percent of the (CE)2 students said 'Very helpful" 
as compared with 11 percent from THS, 29 percent from OSC and 7 percent 
from CWE. When rating how helpful their school/(CE)2 experiences this 
year Had been in helping them to think about their future work plans, 
65 percent of the (CE)2 students said "very helpful" as compared with 
11 percent from THS, 42 percent from OSC and 13 percent from CWE. When 
rating the usefulness of their school/(CE)2 experiences in helping to prepare 
for future learning whether in school or on a job, 42 percent of the (CE)2 
students said "very helpful" as compared with 6 percent from THS, ^32 percent 
from OSC and 7 percent from CWE. In rating 'the relevance of their 
school/(CE)2 experiences in terms of their personal interests and skills, 
almost identical figures, were obtained as for the prior question. The last 
two items in this section of the questionnaire asked students to judge the 
amount of control they felt they had in plaiming and carrying out their 
school/(CE)2 experiences, and secondly, the amount of thinking they had 
done about their school/(CE)2 experiences. In both cases, the (CE)2 
students ranked about the same as. those in the THS and OSC groups and 
-higher thah^the CWE group. 

Students, staff, parents and employers were asl^ed on different questionnaires 
to rate the importance and, separately, the effectiveness of the program in 
accomplishing 15 student learning outcomes. Each of these learning outcome^ 
was given an average rating of three or higher (on a five-point scale) by 
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students/ staff, parents and employers—thus indicating a support for the 
goalS/ of the program. All four groups considered the following student 
leaiming outcomes to be especially important: assuming responsibility for 
themselves, making decisions and following through, communicating with 
others in a mature way, working with others, thinking through and solving 
problems, having a realistic attitude toward self, having a positive attitude 
toward work and learning, and improving interpersonal and social skills • 

The students, staff, parents and employers gave an average rating of three or 
^higher (on a five-point scale) for effectiveness for 11 of 15 student learning 
outcomes listed. These groups felt the following student outcomes were 
being accomplished most effectively: performing specific occupational skills, 
assuming re spoils ibility for themselves, communicating with others in a 
mature way, working with others juid having a realistic attitude toward self. 

One of the major strengths noted by the program staff hds been growth,, made 
by many (CE)2 students in social skills such as assuming niore responfeibiUty 
and increasing their ability to communicate effectively.- "Last year's (CE)2 
graduates have also commented that the program helped them significantly 
to improve their communication ability. This year's (CE)2 students see 
program strength as lying primarily in its provision of many opportunities 
to explore various careers, learn some meaningful skills and be in an 
environment that is friendly and supportive.^ They have also indicated that 
they have encountered no problem in locating and obtaining necessary resource 
materials. Parents, employers, students and visitors have all remarked that 
the (CE)2 staff's competence, enthusiasm i(nd concern have been major factors 
contributing to the program's success.^ In addition to identifying the staff as ^ 
a major program asset, many parents indicated on the Parent Opinion Survey 
that their sons or daughters in (CE)2^ had grown in interpersonal relations 
skills,> knowledge about different vocations and interest in education. 

Interviews with a stratified random sample of 14 (CE)2 students revealed all 
but 1 believing that knowledge or skills acquired in (CE)2 would be directly 
helpful for gaining or holding future iobB. All but 1 of the 14 students were 
also able to describe specific job skills mastered through (CE)2. When asked 
to rank the usefulness of the learning procedures used in (CE)2, the students 
interviewed ranked as most useful actual work on an employer site, working 
on projects, use of tutors, counseling groups and the student retreat. The 
staff saw student projects, competencies and student orientation sessions as 
particularly effective in helping students. 

A list of over 200 job skills and experiences gained by (CE)2 students while 
at employer sites is in^^luded in Appendix M. Skills in all occupational 
areas except the transportation industry are represented. Those areas with 
the highest number of skills learned are office occupations, education, sales, 
and mechanics and repairmen. 



Because (CE)2 depends heavily on employer involvement, employers^ attitudes 
toward the program are critical. Ninety-four percent of the employer 
instructors completing the Employer Opinion Survey stated that they plan to 
continue participating with (CE)2. Many of these employer instructors view 
this pro'gram as a good alternative to regular high school and as an opportunity 
for students to learn about a variety of careers and see what the "real 
world" is like. 

A comparison of career choices identified by the 14 sampled students during 
first semester revealed that 39 out of 4l identified choices had actually 
been covered by exploration levels. One of the exceptions involved a girl 
who said she was considering being a nurse but hadn't told the (CE)2 
employer relations specialist; the second exception involved a student's 
interest in being an airline stewardess for which no exploration levels could 
be arranged. 

Wiiile most of the evaluation findings this year were positive in nature there 
were also some weaknesses uncovered. Many of the (CE)2 students were 
behind sche.dule in completing program requirements, especially student 
projects. The (CE)2 staff have been acutely aware of this problem and this 
summer have designed an improved student accountability system that will 
divide next year into time zones of various lengths with student expectations 
clearly laid out for each zone. 

Employers, parents, staff and visitors were also asked to share problems 
they perceived in (CE)2 this year. Some employers and a few parents 
perceived {CE)2 weaknesses in the inability of some students to handle the 
freedom provided by the program and in their need for more discipline or 
training in self-motivation. Some employers and parents also expressed the 
opinion that a better structure or organization might be needed. Half of 
the operations staff expressed a lack of staff unity as the most notable 
obstacle limiting the success of the program. Visitors most frequently . 
cited the present program cost as a perceived weakness. 

Of the 2\ seniors in (CE)2 as of April 25, 1974, 17 graduated, 5 ciropped 
out of the program, 2 will be returning next year to complete program 
requirements and 3 more may return to complete program requirements. 
The fact that not aU students enrolled in (CE)2 automatically graduate but 
instead are held accountable for successfully completing the program^s 
learning requirements is perhaps the greatest proof of the competency-based 
nature of the program. 

Student recruitment procedures in April and May for the 1974-75 school 
year were highly successful. An attempt was made to recruit at least 
75 students with a wide range of abilities and aspirations to accurately 
represent a cross section of students from Tigard High School. Eighty-seven 
students applied for the program, thus allowing for adequate random sampling 




of participant and nonparticipant students for next year. The baseline Sata 
collected on the newly admitted {CE)2 students indicates a wide range of 
abilities and an accurate cross section of students for next year. 

Cost data are not included as a part of this evaluation report but >yill be 
handled through a separate study being done by a subcontractor to the 
project. 

Recommendations - 

!• Many of the recommendations for program improvement that could 
have been made in June^are no longer relevant since the operations 
staff have been keenly aware, of problem areas this year and have 
spent the summer in building improvements into the program. For 
example, • the student accountability system has been thoroughly revised* 
to better communicate to students what is expected; of them and to 
monitor regularly such accomplishments. Weaknesses in the design 
and execution of student prpjects have been corrected and -some 
pSfe-prepared projects developed to better ^insure student achievement, 
of program outcomes, encourage greater use of employer and community 
sites for project work, and make more efficient use of learning 
managers' time in writing and negotiating projects with students. 
Likewise, meaningful changes have occurred in the competencies, 
Exploration and Learning Level Packages, and in systems for 
delivering improvement in Basic Skills. 

2. For next year it is recommended that continued care be given to the 
evaluation of (CE)2 while at the sai&is time evaluating the planning 
phase of program replication in other school districts. 
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. Appendix A 
DESCEIPTION OF INSTRUMENTS 

Three? staadardixed instruments; developed and tcsteil by resqarclurs outside 
the EBCE program were used by NWREl* evaluators to assess student 
achievement, attitudes, and social' and career awareness. In addition, a 
variety of other instruments was developed for use in gathering data from 
students, parents, employers, visitors 1:6 the program, (CE)2 graduates and 
program operational staff. 



Standardized Instruments 

Cateer Maturity Inventory . Developed by Dr. John O. Crites and published 
by California Testing Bureau/McGraw Hilf, the CMI contains an attitude scale 
and five competence scales. The following definitions were paraphrased by 
the evaluation staff from the designer's original descriptions of these scales; 

1. The Attitude Scale measures the individual's attitude toward making a. 
career choice and entering the world of work. The test assumes that 
the measures of the "maturity" of an individual's attitude are the degree 
of his indepSlndence and involvement in the choice process and his 
ability to see work as a meaningful focus of life. 

2. Knowing Self measurQs the ability to project the most appropriate 
response to a given set of circumstances involving individuals and 
appropriate career choices. 

3. Knowing Job measures the ability to ^recognize certain careers from 
descriptions of specific job tasks. 

4. Choosing a Job measures how adept an individualsis in matching personal 
characteristics to occupational requirements. 

5. Looking Ahead measures the ability to recognize the appropriate 
sequence of events necessary to prepare one for entry into a variety 
of careers. 

i 

6. What Should They Do measures how effectively the student can cope 
with problems (i.e., select an appropriate response to a given set of 
problematic circumstances that arise in the course of career development). 
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On the basis of careful analysis of the technical manual* accompanying Uic 
CMI and answers by staff members from three EBCE- labs on a trial run of ^ 
the test itself, NWREL evaluation staff concluded that major parts of this 
instrument arc ini^ppropriate for evaluation of EBCE programs. For example, 
an assumption that students are not able to actually "try out" a variety of 
jobs underlies many of the questions. While this assumption may be justified 
in many school-based traditional programs, it is certainly contradictory to 
the major thrust of the EBCE concept. (eE)2 staff and evaluators also . 
question the implication that one may predict the most likely career line of 
a given individual on the basis of only two or three personal attributes or 
interests, these objections and requests by administrators of cooperating 
schools to reduce time /required for standardized testing resulted in the 
decision to omit parts- three and five of the CMI Competence Te^t with all 
groups tested at midy<2ar. Shortage of testing time also resulted in 
administration of only the Attitude Scale to the Cooperative Work Experience 
group. The Attitude Scale was used because it is the scale for which the 
publisher provides the most technical documentation. 

jpsvchosocial Maturity Scale . Developed by Dr^_Ell^n Greenberger and 
associates at Johns Hopkins University, the J*SM is based on biological, 
psychological and sociological models of maturity. The scale measures 
nine variables contributing tc psychosocial "maturity^ and yields nine subscores, 
a total test score and a measure of the validity of the responses. Individuals 
respond on a four point scale from strongly agree to strongly disagree to 
statements such as "I believe in working only as hard as I have to. " 
' Paraphra.sed descriptions of the nine variables of psychosocial maturity and 
the validity scale are given below together with examples of questionnaire 
items. 

1- Work . An indiviflual's standards of competent task performance and his 
capacity to experience 'pleasure in work are encompassed by the concept 
of work. (Example: "I can't think of any kind of job that I would like 
a lot.") 

2. Self-Reliance . Items pertaining to the concept of self-reliance may 
address one or more of three factors: an absence of excessive 
dependence on others, a sense of control over one's life and initiative. 
(Example: "You are probably wrong if your friends are against what 
you decide. ") ■ ^ _ 

3, Identity . The four components of identity are increasing clarity 

^ of self-concept, consideration of life goals, internalization of values, 
and self-esteem. (Exaniple: "I change the way M feel and act so often 
that I sometimes wonder who the 'real' me is. "K , 



* Ciites, John O. , Career Maturity Inventory: Theory and Research Handbook . 
CTB/McGraw Hill, Monterey, California: 1973. 
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4. Communications . Communications .involves skills in ''sending" or 
encoding verbal and nonverbal messages, sldlls in "receiving'' or 
decoding verbal and nonverbal messages, and empathy. (P:xanple: 
"People find it hard to figure mo out from what I say. ") < 

5. Role . Knowledge of roles involves both an awareness of obligations 
inherent in current definitions of major I'ules an^ an awareness of 

. priorities that gov.ern the resolution of role conflicts. (Example: 
"Teachers should not expect as much homework from athletes who 
have to spend a lot of time at practice. ") ^ 

6. trust . Three basic attitudes characterize "enlightened" (credible) 
trust; general belief in the acceptability of reliance or dependency 

on others, rejection of simplistic views of the "goodness" or "badness" 
of human nature, and recognition of individual and situational factors 
that limit trustworthiness. (Example: "If people are picked in a fair 
way to be on a trial jury, they are sure to reach a fair decision. ") 

7. Social Commitment . The dimensions of social" commitment are feelings 
of "community" with others, willingn'ess to modify or relinquish personal 
goals in the interest oC social goals, readiness to form alliances with 
others to promote social goals, and investment in long-term social goals. 
(Example: "It's not really my problem if my neighbors are in trouble 
and need help.") 

8. Tolerance . Tolerance involves the person's willingness to interact with ^ 
individuals ^nd groups who differ from the norm and an ability to be 
sensitive to their rights. It also involves an awareness of thq. costs and 
benefits of*tolerance. (Example: "If I had a choice, I would prefer a 
blood transfusion from a person of the same skin color as mine. ") 

9. Change . The change variable includes general openness to socio-political 
change and recognition of the costs of both the status quo and change. 
(Example: "If everyone is to be really equal, some people will have 
fewer advantages than they have now.") 

10. Social Desirability . (Validity Scale) This variable reflects the tendency 
to respond in the socially acceptable Way. It is not a factor of "maturity 
but serves instead as a validity check on responses to other items on 
the instrument. (Example:. "I have never told a lie.") 

The version of this i-nventory used fo^ midyear testing has been revised since 
the September pretest. Research and analysis of test data by Dr. Greenberger 
and (OE)2 program evaluators revealed that the test was unnecessarily lengthy. 
The test was revised by dropping 101 items which were repetitious or had low 
item-test correlations. The 102 items retained appear -exactly as they did in 
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the original version. Hence, pretests were simply rescored and comparisons 
were made on these items only. The resultant instrument, although only half 
as long as the original, still yiokis valid information on all nine subscalcs. ' 

Comprehensive Test of Basic Skills . The California Testing Bureau/McGraw- 
Hill CTBS was used as the primary Basic Skills instrument. Level 4 was 
chosen for two -reasons. First, it wasr the same level used in the 1972-73 
School year for (CE)2 assessment. Since the spring 1973 posttest scores for 
ihkreturning seniors were used as their fall pretest scores, a consistent 
•Ifevei of the testrhad to be maintained. Secondly, since comparisons were 
toie made >between (CE)2 students and a random sample of Tigard High School 
students, Ldvel 4 (developed for senior high school students) was deemed 
most appropriate., This standardized test yields four subscores and a total 
' test score. Kaw scores on all subtests have been transformed to an expanded 
standard score which makes • comparisons across the various forms qf the 
test possible. 

: 1. Reading . The reading subtest measures a student's use of vocabulary 

and his ability to comprehend the meaning of ideas, to interpret what is 
read, and to recognize the author's intention. 

2 Language . The language subtest measures the student's ability to use 
. * - punctuation, capitalization and spelling correctly and' to express himself 
efficiently and effectively. - 

3. Arithmetic . The arithmetic subtest measures the student's ability to use 
the four fundamental arithmetic operations, to recognize and use the 
appropriate arithmetic concepts (principles, formulae, decimals, 
exponents,' etc.) and to use arithmetic in problem solving. 

Study Skills . The study skills subtest measures the student's ability to 
use reference materials (library, dictionary, etc.) and graphic materials 
(maps, charts, symbols, etc.). 

Since the standard error of measurement for the CTBS is rather large, it was 
agreed that reliable change scores could not be expected on this measure in 
only a half year. ^Therefore, the evaluation design calls for administration of 
the CTBS only in September and Mdy. 

Instruments Developed For Use Across All F our EBCE Sites 

At the September meeting of evaluators from the four EBCE sites, it was 
agreed that certain questionnaires would be dd'Veloped and used commonly across 
all four EBCE sites. These questionnaires were designed to provide NIE with 
comparable data from all sites for their use 'n describing the EBCE program. 
The perceptions of EBCE students, EBCE graduates, visitors, parents, employer 
instructors and program, administrators are assessed by these instruments. At 
the meeting, the major areas of focus for each instrument were agreed upon 
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and responsibilities for developing each instrument were assumed voluntarily 
by each Laboratory. The various parties agreed to finalize instruments as 
follows: Research for Better Schools, the §tudent and parent (lucstionnaircs;^^ 
AH)alachia Educational Laboratory, the employer questionnaire; Far West 
Laboratory, the EBCE graduate questionnaire; Northwest Regional Educational 
Laboratory, the visitor questionnaire; and the NIE evaluation coordinator, the 
project director questionnaire* ^ V ; ;^ 

In December the EBCE evaluators frdin,^each of the Lal>6ratories met to 
review drafts of each instrument* These;;drafts were modified and a final 
version agreed upon. Except-^for th^vE^^GE^ graduate follow-up questionnaire, 
the commonly-devcloped instruments :;w^re administered at each of the four 
sites in February. ' 

Student Opinion Survey . The Student 'Opinion Survey was designed to assess 
(CE)2 students' attitudes toward work and the EBCE program, reasons for 
joining the program and learning outcomes of the EBCE program. In addition 
to the ''common" questions on this instrument, NWREL evaluators added some 
local questions regarding learning level experiences, factors influencing students 
to join (CE)2 and knowledge about three jobs of potential Intercast to each 
-student. Questions measuring career knowledge of jobs of potential interest 
to each student were developed as a. more direct measure of Student knowledge 
of careers. This was deemed necessary because tlie evaluators were 
concetned about the content validity of the CMI coinpetence scales and because the 
(CE)2 individualized program docs not require that all students learn information 
about the same careers. Td' obtain comparative data on these questions, a 
short questionnaire was also administered to the TUS random sample and to 
the students of the OWE program. A copy of the Student Opinion Survey containing 
tabulated responses. of (CE)2 students to all questions— and responses of THS 
random sample students and OWE students to questions about career knowledge- 
is located in Appendix C. ^ 

Parent Opinion Survey . The Parent Opinion Survey was designed to assess 
(CE)2 parents' perception of project strengths and weaknesses, benefits of the 
program to their son or daughter and the extent^ of their involvement in the 
program. A copy of the Parent Opinion Survey containing tabulated responses 
^ of (CE)2 parents is .located in Appendix D. * ^ 

Employer Opinion Survey . The Employer Opinion Survey was designed to ask 
employer instructors for factual information about their work and their 
interactions with (CE)2 students and how they became involved with (CE)2. 
Employer instructors were also asked to evaluate students^ with whom they 
worked, the impact of (CE)2 within their company, the operation of the program 
and the perceived importance of selected student learning outcomes. A copy 
of the Employer Opinion Survey containing tabulated responses of employer 
instructors is located in Appendix E. 
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Project Director Questionnaire . The Project Dirdctor Questiomiairc was 
completed jointly by the NWREL Career Education Prograni Director and the 
(CE)2 Project Director. It contains both factual information and the 
administrators* opinions about the program, staff, students, employers, ^ 
unions, community resources, parent contacts and the program advisory board. 
A copy of the Project Director Questionnaire is located in Appendix F. 

Visitor Questionnaire . The Visitor Queptionn.Mre was designed to ask visitx^rs 
how they first learned about (CE)2, tlsc 'aspects of (CE)2 they observed, their 
overall impressions of (CE)2, what aspects of the program they would like to 
see tried in other school districts, and the areas of (CE)2 about which they 
would like to receive further information.. 

Locally Developed Instruments 

Student Background Questionnaire . The Student Background Questionnaire was 
developed in alternate forms for obtaining background information in September 
for students in the EBCE program and .in the comparison groups. In the 
questionnaire, information about family background, students'- previous 
employment history, short- and Jong- range educational and work goals, 
involvement in high school and community activities.^ hobbies, reading habits 
and reasons for entering a career/vocational education program were requested. 
A tabulation of responses by grade level and group is displayed in Appendix G. 

jCE)o Staff Questionnaire . The (CE)2 Staff Questionnaire was administcrcfd/ 
in February and asked the staff to rate the importance and perceived effedtiyeness 
of learning strategics used in (CE)2 and student learning outcomes. It also ; . 
contained questions dealing with the ^staffs' perception of factors contributing^ ' ^ 
to and those limiting the success of fhf^ prograni, changes th^y would suggest 
in the program, usefulness of various types of assessment or evaluation , ; 
information, and areas in which students have made greatest and least growth 
so far this year. A copy ot the (CE)2 Staff Questionnaire containing tabulated 
responses of each of the (CE)2 operations staff is located in Appendix H. 

jCE)o Student Interviews . The structured (CE)2 Student Interview was designed 
to explore (CE)2 students' attitudes toward the program, to answer certain 
formative evaluation questions, and to validate January student questionnaire 
responses to questions regarding particular information ^about careers they would 
like to enter. Interview questions focused upon student interact/ions .with, staff, 
knowledge and skills gained in (eE)2, student projects, work itt Basic Skills, 
perceived usefulhcss of 17 specific learning processes in {CEU and student 
overall attitudes toward the program. DiscussioA-oWlicseJiftdings occurs 
withui various subsections of the formative evaluation section ^ofjMs report. 
A copy of the February (CE)2 Student Interviews, containing tabulated responses, 
is located in Appendix I. 
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sema ntic Differential . The Semantic Diffcronlial is an instrument that measures 
in an indirect way students' feelings about certain concepts. In t)us case, the 
concepts of me, school , adults , learning , work, decision making, and community 
resources were chosen by (CE)2 operations staff and a clinical psychologist - 
as central concepts in the (CE)2 program. Using a r,-poLnt scale, slu(l(>nts rat(>(l 
each concept in terms of the following 15 polar adjectives: interesting-boring, 
unfriendly-friendly, good-bad, easy-difficult, scary-fun, tense-relaxed, reasonable- 
unreasonable,, sad-happy, wise-foolish, irrelevant-relevant, open-closed, pamful- 
plcasurable, important - unimportant, weak-strong, and warm-cold. 

(CE)9 nv^Hn nfo Interview and Questionnaire . A combination telephone interview 
m^d brief written questionnaire was designed to obtain some factual information 
about the oresent educational and/or vocational activities of the seven (CE)2 - 
graduates of last year, their attitudes about what they had gained from being 
in (CE)2 and their perceptions of the importance and effectiveness of fifteen 
learning outcomes. Some of the questions were adopted from the draft 
questionnaire developed by the Far West Laboratory EBCE evaluation staff. 
Other questions were based upon the long-range objectives that the evaluators 
and staff had discussed last summer. A tabulation of the ^{CE)2 Graduate 
Interview responses is contained in Appendix J. 

N ewspaper Reading Exercise . Two parallel forms of an objective-referenced 
Newspaper Reading Exercise were developed and pilot tested several times 
this year prior to use with selected (CE)2 students. With the assistance of 
a local newspaper staff member, two news stories and two editorials were 
selected as the basis for the instrument. . For each form, nine multiple-choice 
questions were deveTope.' to measure the student's ability to -recognize the main 
points of the selection, tecognize the author's purpose and locate specific 
-facts and details. This instrument was designed to create a more "real • 
world" task than formal reading tests. The reliability of the Newspaper 
Reading Exercise, as indicated by the Kudor-Richardson 21 formula, ranged 
from . 56 for 35 seventh graders to . 63 for 23 ninth graders. Reliability 
■ * ' data for high school students is not yet available. A validity check run on 

data from a sample of 14 (CE)2 students yielded a correlation coefficient 
of .70 between scores on the Newspaper Reading Exercise and the CTBS 
Reading subtest. ^ 

Student End of Year Questionnaire . The Student End of "Year Questionnaire 
was administered to (CE)2- and comparison group students at the end of the 
school year. The instrument was designed for the following purposes: 
(1) to follow up on question asked on the Student Background Questionnaire 
administered at the beginning of the year' to assess any change that might 
have occurred during the year; (2) to assess student knowledge about job 
trends and related information as a one-time measure to be compared to 
national norms; and (3) to collect data on student reflections about their 
schooi/(GE)2 experiences.^ ^ 
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Non volunteer Questionnaire ^ A Nonvolunteer Questionnaire was developed to 
determine the reasons why some students did not express an interest in 
(CE)2, what changes would have to be made in the program to make it 
interesting to them and how adequate the recruitment information was for 
students. Parental reactions to the program and background information 
were also requested m the quesliomiaire. , 
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Appendix B 



Included in Appendix B is a letter from Dr. Fred Forster, the 
independent educational auditor to Ms. Mary Ann Millsap, NIE 
Coordinator of Evaluation for the EBCE projects. The entire 
audit report was not available as this report went to press but 
will be available as separate report in the near future. 



V 



September 23, i974 



Ms. Mary Ann Millsap 
Evaluation Specialist 
Career Education Program 

Department of Health, Education, and Welfare 
National Institute of Education 
•Washington^ D.C. 20208 

Dear Ms. Millsap: ^ 

Enclosed is a copy of the audit report for the Final Evaluation 
Report/Experience-Based Career Education (CE)2 project prepared by the 
Northwest Regional Educational Laboratory. As you will note, some minor 
change$ and a feW alternative statistical techniques^have been suggested, 
but the overall quality of the evaluation effort appears to be excellent, 

A copy of this report has been shared with Northwest Regional Educa- 
tional Laboratory personnel in hopes of supporting their efforts for the 
coming year. 




FF:dk 
End, 
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Appendix C 

(CE)2 STUDENT OPINION" SURVEY RESPONSES 

This survey is meant' to give you an opportunity to e:>cpress your opinions 
jfcout the Career Education Program you have been participating in. Most 
of the questions are to be answered on a scale of nutbers franQto(|>. The 
words at the top ana bottom of each set of questions tell you vAiat the nurbers 
nean. A ©may mean sonething like "Definitely No"; if you feel very strongly 
that the answer to the question is NO, then you should circle theQ. A(5)inay 
nean "Definitely Yes"; if you feel very strongly that the ansver is YES, 
Mxen you should circle theQ. Ihe nunbers in between (2,3,4) mean that your 
opinion is neither "Definitely ^5o" nor "Definitely Yes*, but satewhere between 
than. You should circle the nurrber that is closest to ycur real opinion of 
what the question is asking about. Sons scales have different words, but 
they always work the sane. Read the words above and belcw the nurbers so 
you know what the hiittfers mean. Read the questions carefully, and circJfi the 
nurter which is the closest to your opinion. Ther^ are no ri^t or wrong 
answers; your thoughts and feelings are the iifportant things in this survey. 
The answers,, students give will be used to help determine hew veil the program 
is dDing now and to iitprove it in the future. Remanber to circle a nu*>er to 
answer each item. If you have any questions while you're oanpleting the sur- 
vey, just ask for cissistanee. 
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PUBASE CIRCLE ONE NUMBER FOR EfiOI QUESTION Definitely Definitely 







No 

1 


2 


3 


4 


Yes 

5 . 


i. 


Have you liked atter^ing the Career 
Educatiai Program? 


0* 


0* 


12* 


30* 


58* 


2. 


If .you had it to do over again, do you 
thijik you would decide to participate 
in the. Career Education Program? 


2 


2 


23 


16 


56 


3. 


Have the activities available in the 
Career Bdufcation Program been interes- 
ting to you? 


0 


0 


23 


56 


21 


4. 


In the Career Education Program have 
- you felt that you could progress at 
your qwn rat:e? 


" 2 


5 


16 


35 


42 


5. 


Have you seen much of a relationship 
between your activities in the learning 
center and the careers you have learned 
about? 


- 

2 


7 


30 


4£f 


12 


6. 


Do you get enough feedback about how 
. well, you are doing in the program? 


5 


12 


14 


33 


37 


7. 


Have you had enough choice in deciding 
the amount of time you spend at enployer 
sites? 


7 


14 


9 


28 


42 


8. 


Have you had enough c±oice in deciding 
the amount of tome you spend in leamxng 
academic subiects? 


7 


7 


23 


37 


26 


9. 


Have you had enough choice in deciding 
\N/}iat you do at employer/resource sites? 


, 2 


14 


28 


30 


26 


10. 

A 


Have you hed enough dioice in selecting 
the types of aiT>loyer/resource site^ 
von visit? 


0 


5 


26 


26 


40 


11. 


Do iTDSt people receive much satisfaction 
frati their work? 


0 


7 


30 


51 


12 


12. 


Do you think that if a person works 
hard enouqh, he can achieve anything? 


2 
1 


0 


7 


37 


53 

1 






Definitely 
No 




Definitely 
Yes 



PLEASE ClklLE ONE NIJMBER FOR EAQI QUESTION 



♦Figures indicated are percentages of student responses (N = 43) 



PUEASE CIROIE ONi: ^RIMDI^R FOR EATl I QUESTION Definitely Definitely 







No 


2 


3 


4 


yes 

- 5 


13. 


Do you thirJ;^ that the nmn reason a 
person works is to 'earn enouqh ironey 
to live? 


2 


7 


33 


33 


26 


. 14. 


In general, are you looking forward to 
working in a iob? 


0 


12 


19 


44 


2G 


15. 


Do you think you have inuch choice of 
occupations? 


5 


5 


19 


33 


40 


16. 


In general, were? the orployer /resource 
personnel involved in the Career 
Education Program awajre of vour needs 
and interests? 


0 


■7 


35 


35 


23 


17. 


In general* at OTplover/resource sites 
did you get to actually do things 
rather than iust listen? 


0 


- 

9 


9 


- 

26 


56 


18. 


In general, have tho ei^loyer/resouroe 
sites you've visited been interested 
in the Career Education Program? 


2 


0 


✓ 

21 


49 


28 


• 19. 


In general- have you felt welcana at 
the enplover/resource sites? 


0 


5 


28 


35 


' 35 


20. 


Do nost of the OTplover/resource. sites 
you have workal with let you Vjio^ how 
you* re procjressii\g? 


2 


- 

19 


28 


35 


16 


21 


Through your cxixirionccs in the Career 
Education Program have you learned a lot 
about opportunities for the future? 


0 


2 


23 


21 


53 


22, 


Do you plan id got a secondary school 
diplcma? 


12 


10- 


O 1 


12 


36* ' ^ 


23. 


Wbuld you say the Career Education Program 
has "helped vou form career plans? 


0 


9 


9 


28 


53 


24. 


VJbuld you say -youVe learned a lot v^ile 
attend ixKf the Career Education Program? 


0 


2 


14 


28 


56 








Definitely 
No 




Definitely 
Yes . 



PLEASE CIPOiE Ota; 1>IUMI3ER FOR EAQl QUESTICN 
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KJEASL CIPCLE OIIL: IJUMDIU^ TOR EAQl QUESTIOI 



25. Ho^ well orcjanlzixl aivj coor^iinatcd 
do vou think tliO Career Education 
Program has been? 

26. How would vou rate.- tfhe general ^? 
. quality of the^ Career Education -. 

Program staff? ' / * ^ 

27. ' How' would vou rate the personal 
counseling available in the 
Career Education Prxxiram? - 

, 28. How would vou rate the career • - 
/ counseling available 'in the Career 
Edixration Program? 

29. How would vou rate the general ^ 
qualitv of the Career . Education ' 
Program' enplover/rcsources you've- 
vn rkPd with? , 



Poor 

12 3 4 



Excellent 



0-2 37 56 



Poot 



0 5 7 ' 40 . 49 



0 5 2 12 81 



2 ... 0 L7 45 36 



Excellent 



30. 



How ijTportant was^ each of the follQW- 
ing factors in deciding to join the - 
Career Education, Program? 

a. I wanted mote freedon\/ii>dq?endence 

b. I wanted ^ choose^ my cym leamipg 
style V . 

c. I want^ to learn about carets 

d. I didn't like my piQbyious school 
I wanted to prepare for a job 
I was bored with'' school 



I heard the Career Education Program 
was easy 



h. Other (specify) 



Not at all.. 
Important ■ 



5 

,0 



4- 



Extremely 
Important 
5 



5 
2 

■ 7 
0 
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Not at all 
Inportant ; 



.16 



28 ' 44 



■ 5 51^ 35 

2 42 53 

26 ' "l9 40 

5 ilG •■ 56 



40 31 17 10 



Extraitely 
Inportant 



PLEASE CIRCLE OWE NUMBER VOR EACH QUESTION 
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PUEftSE CIPCLE ONE NUMBER JX)R EACH .QUESTION 



/ 



r 



'31 • In conparison with regular schcx)ls , 
. how much opportunity did the Career 

Education ProQram provide vou for 
. learning about occupations? 

32. ' In conparison with regular schools ^ 
. how much opportunity did the Career 

Education Program provide vou for 
general le^umhg? 

33. In ocrparison with past experiences in 
regular sdKols, ho/ motivatedrare you 

, to learn in the Career Education Pro- 



Much 
IjCss 
1 



About 

the 
Same 

3 '1 



Much 
More 



12 84 



0 
0 



5 
0 



21 43 31 



12 33 




56 
4— 



Much 
Less 



About 
the 
•Same 



Much 
'More 




1 I 

34 X ixiring thLs schCx?! year have you 'vrorked outside of heme for noney? 

a. lis} , No ' ^ 

b. m Yes, less than llO hours a week 
Q.*|3l Yes,, befcween'lo fldia .20 "liours a week 

d. d] Yes, between 20 and 30 l?ours a yj5^ 

e. 'dl Yes, more 'than 30 hours a week- 

35. If you have an outside jcb, does it interfere with anythi ng listed belcw? 

a. ^ I don't have a regular outside job 

b. 0 My job doesn't interfere with any other activities " 
•c. 0 It interferes with ny school work 

d. di It interferes with my social life - 

e. [o] It interferes with nty extracurricular activities - 

36. Wiat changes, if any, 'would you like to see in the Career Education Program? 

~A more organized program (7)* \ ' . " 

—Change j^pccific program activities (3) ^ ^ 

—Eliminate joui-nrfl3 (2) 
— Less work ^ 
' — None/no ^response (2G) 
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♦Numbers in parenthescs'Vndicatc actual number of 
percentages " 



students responding, not 
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Below are listed \arious areas of po&sible importance for yourtg ^people to learn. 
Please rate each in terms of how important you feel it is to learn these things, and 
how well you feel the program is nccomplishing each. 



Students learn to: 

a. Perform specific occupational skills 



b. Be punctual and organize their time 



c. Assume responsibility for themselves 
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Make decisions and follow through 



How Important Do 
You Feel This 



Learning Is? 


Not 


Highly 


Impor- 


Impor- 


tant 


tant 


1 2 3 


4 5 



0-* 5* U"^ 33* 48* 



0 5 14 2G 58 



0 0 9 23 67 



5 19 74 



Communicate with others in a 
mature way 



f. Be aware of more career 
opportunities 



Work with others 



Evalute their own work 



i. Perform basic academic skills 



j. Think through and solve problems 



Have a realistic attitude toward self 



K Have a positive attitude toward work 



m. Have a positive attitude toward 
learning 



n. Prepare for further education 



Improve interpersonal and social skills 



Other (please specify)^ 



0 7 28 G3 



0 2 14 23 60 



0 0 2 20 78 



0 4 26 - 38 32 



4 13 41 40 



0 11 21 66 



0 0 11 25 64 



0 11 33 54 



0 0 14 19 e'i 



2 11 28 26 33 



0 2 24 29 45 



How Effective Do Yc-u 
Feel the Project Has 
Been in Accomplishing 
This Learning? 


Not 
Effec- 
tive 
1 


o 

2 


o 

o 


Highly 
Effec- 
tive 
4 a 


0 




24 


41 34 


2 


2 


19 


43 33 . 


0 


0 


12 


52 36 


2 


0 


22 


27 49 


2 


0 


19 


33 45 


0 


0 


12 


29 GO 


2 


0 


12 


30 56 


0 


2 


' 30' 


41 27 


0 


0 


21 


45 34 


0 


4 


20 


30 46 


0 


2 


23 


38 37 


2 


2 


24 


34 38 


0 


0 


23 


32 45 


2 


7 


19 


40 32 j 


0 


2 


25 


32, 41 1 


t 
1 



*Figi»i*'*s indicated are percentages of student responses. Generally, N 41 to 43. 



« 

38^ Please check the hoxvs following each statement which best describe your mos t 
recent Learning L.cwel experience . 



Did you sometim(»s take over'a job for a regular 
employee who wasn^t there? 



Did you usually work alone? ^ 



Were you asked to take on new responsibilities before 
you were ready? « 



Did you learn something new most days' 



Did you get interested enough in things to try to learn 
about them off of the employer site? 



Did you do more difficult things at the end than when you 
first started? 

Did the employer get upset with you when you made a 
mistake ?.-..'... • • • 



Did the employer tell you when you did a good job ? . , 

Were the regular employees bossy? ; 

Did you get clear instructions when you needed them?. 



Did you do things off the sites with the regular employees 
you worked with?.' v* • 



Did you ever talk with the people at the.^ site about your 
opinions .and feelings ? • 



Were you free to talk and joke around with the people at 
work ? 

Do you think it is now easier for you to talk to adults 
because you had this experience? 



69 



96 



69 



Did you have many different assignments at this site? (83 



Do you think it will be easier for you to work in a 
regular job because you ha^d this experience?. . . . 



85 



^Figures indicated are percentages of student responses (N = 42 or 43) 







Don't 


Yes 


No 


know 


37 ■* 






4 * 


30 


••70] 


r?; 


18 


78 


Q 


83 


■ 11 




Q 


73 


16 




11 



16 



6 




85 


. 9 


85 


11 




4 


9 




87 




4 




0 




0 


32 




64 




4 


61 




37 




2 



19 


[11 


El' 


□ 


□ 
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Please list three jobs that you feel you might like to hold after completing 
vcur education. Under each iob indicate how vou have learned about the 
job. For example, if the first iob you wrote^n was auto mechanic and you have 
uotton information about it from friends, from reading about it. a nd from actual 
work experience, you would put a check mark It^) in the first column across 
from" numbers 2. 6. and 7. 



HOW HAVE YOU LEARNED ABOUT 
EACH JOB? (Check the categories 
that apply under each of the three 
occupations. ) 



WRITE DOWN THE SPECIFIC 
JOBS HERE: 



THS 
N = 36 



CWE > 
N = 20 



(CE)2 
N = 43 



1. 
2. 
3. 



6. 



7. 



From my parents or relatives 

From friends 

From someone who works 

f 

in that job 

From a teacher or counselor 
at school . 

From a computer information 
system 

From reading about it 

Actual work experience 

f 

Other reasons . 



9. None 



36* 


23 


14 ' 


35 


23 


21 


56 • 


38 


46 


25 


13 


32 


2 - - 


0 , 


19 


48 


42 


28 


27 


15 


43 


13 


8 ' 


. 12 









♦Percentage of jobs using each source of information 
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40. Write down t'he same three jobs you listed in the prior question. For each job 

listed, indicate what you think is tho: (1) starting monthly salary. (2) the highoHt 
education required (for example, high school graduate, apprenticeship program . 
college degree, post college professional degree, etc.). and (3) any special skills 
required (for example, a dentist nerds good eye/hand coordination). If you have 
no idea of the salary or other information about a lob, write "Don't Know. " 

Average Score by Category (Scores range from 0=Don't Know 

l=Some Info 
2=Right On) 



Likely Jobs 



1. 



Starting 
Monthly 
Salary 
THS CWE 
.8(5 1.05 



,75 



-.83 



(CE)^ 
.50 



.45 ' .42 



Highest F^ducation 
or Training 
Required 

THS CWE (CE)2 
1.25 .80 .90 



SpeciaJ Skills Required 



,95 .39 1.05 .95 



,79 



1.03 .10 



70 



THS 
.78 


CWE 
.70 


(CE)2 
.55 


.25 


.20 


.18 


.64 


.55 


.56 


.19 


.25 


.23 


.80 


.20 


.37 


.36 


.10 


.14 



41, Many factors and people influence our decisions^ How did the fo llowine factors 
or people influence your decision to participate, or not participate, in the (CE) 9. 
program? Circle the number which best describes their influence. For example, 
if your parents were not influential at all, circle 0; if thev enco uraged vou a lot 
to partlciPftte* circle +3:- if they actively discouraged participa tion, circle -3. 

Percentage of Students/Category 



Strong Influence 
Not to Join 
(CE)2 



No 
Influence 



Strong Influence 
to Join 
(CE)2^ 







-3 


' -2 


-1 


0 


+1 


+2 


+3 




.THS 


3 






85 


3 ' 


6 


3 


Influence of Parents 


CWE 




5 




74 


5 


ll 


5 




(CE)2 


5 




5 


33 


9 


12 


3*^ 




THS 


3 


3 


14 


63, 


\;i2 


3 


3 


Influence of Friends 


CWE 




11 


5 


' 42 


26 


16 






• lPEi2. 


2 




2 


35 


26 


12 


23 


Influence of Teachers 


THS 






6 


80 


3 


9.' 


3 


or Counselors 


CWE' 


5 






03 


5 


26 


30 


LCEJ2 


5 






• 44 


9 


12 




THS 


14 


6 


6 


54 


6 


6 


9 


Your Own Concerns 


CWE 


5 






58 


5 


21 


11 


About Your Future 


iCEj2 








7 




16 


77 
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THANK ^YOU FOP YOUR TIME IN COMPLETING THIS. SURVEY I 
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PARENT OPINION SURVEY* 
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How well docs the Career Education Program compare overall w ith the past 
school experiences of your daughter or son ? 



Much 
Worse 



0 



4*"* 



8** 



33*=*' 



Much 
Better 

54**' 



^ 2 ' 3 . ,4 

If vou had it to do over again, would you want your son or daughter to 



participate in the Career Educa tion Program? 



i 



Definitely 
NO 



0 



8 



8 



Definitely 
YES 



79 



How. well do you 



1 2 3-4 5 

think v-our son or daughter likes the .Career Education Program 



compared with past school experiences ? 



Much 
Worse 



25 



Mjuch 
Better 

67 



What do you think are the greatest weaknesses of the Career Edu cation Program? 
—Lack of structure/not well enough planned (3)*** 

—Parents should be told more (2) „ 

—Needs more discipline/training in self-motivation (5) 

— Not sure/none (4) ' ' 

—Other (3) ' 

What do you think are the greatest strengths of the Career Educa tion Program? 
"Staff-stiiderit relationships/quality of the staff (5)*** 
"fndividualization/management (4) 

—On-site jobs/developing interests in various skills (7) 
"Interesting or good way of getting students to learn (2) 
—Experience with employers/workers (5) 
"Other (1) 

"Ndt sure/none (1) 

♦Figures are based on the responses of the parents of 25 students 
**Figures represent the percent of reso^^ndents chooaiug each alternative 
♦♦♦Figures represent the actual number of respondents choosing each alternative 



7. 



8. 



Have you received enough information about your son or daughter's progress 
in the Career Education Program ? 



Definitely 
NO 



0. 



1() 



Definitely 
YES 



40 



.1 .2 3,4 5 

In comparison with regular schools how much opportunity did the Career 
Education Program provide your daxighter or son for learning about occupations ? 



Much 
Le&s 



0 



About the 
Same^ 



0 



17 



Much 
More. 

7S 



.1 2 3 4 (.5 

What effect^ if any> has the Career Education Program had on helping your 
son or daughter form career plans ? 



Definitely 
Bad 



0 



No 
Effect 

13 



30 



Definitely 
Good 



52 



9, In comparison 



I 2 3)4 5 

with regular schoolB hp^ much opportunity did the Career 



Education Program provide your daughter or son for general learning (i. e^ ^ basic 
skills and life skills) ? 



Much 
Less 



About the 
Same ^ 



42 



Much 

M[pre 

50 



10. 



In comparison with past experiences in regular schools how motivated is your 
daughter or son to learn in the Career Education Prograni? 



Much 
Less 



0 



0 



About the 
Same 

17 

T 



25 
^4" 



Much 
More 

58 
5 



^ 2 

How^would you rate the approaches to learning used in the Career Education Program ? 



Poor 



Excellent 



ERIC 



0 



0 
2 



17 
3 



25 
"4 



58 
5 



I>2 



12. What positive changes have you noliccci in your son or daughter that might be 
a result orbarlicipation in the Career Kducation Program? 

—More confident and optimistic about self and future (3)*** 
—Better interpersonal relations/more mature (10) 
—More interested in education (7) 
— More interested in knowledge about jobs (4) 
, — None (3) i 1 * ' 

--OUuM' (2) 

13. What negative- ehanK^os have you noticed in your son or daughter that might be 
a result of participation in the Career Education Program ? 

—None (18)**.* | 
—Other (3) 



14. How often does your son or daughter talk to you about what's going on in the 
Career Education Program ? 



Almost 
Never 



8 

T 



36 

"3 



16 

' 4" 



Almost 
Daily 



36 
1 



15^ Before entering the Career Education Program, how often did your son or 
daughter talk to- yoU about what was going on in the regular school ? 



Almost 
Nev^T 

30 



13 



26 

3" 



Almost 
Daily 



'22 
5 



12 3 4 

16, About how oftc>n have you had any contact with' any Career Education Program 
staff members? 



Almost 
Never 



8 
'1 



28 

"2 



32 

3" 



20 

T'- [ 



Very 

Frequently 



12 
"5 



17. How many meetings have you attended during this school year where other 
parents of Career Education students wore present? 



ERIC 



None 
57 



14 
1 



24 
2" 



5 
3 



4 or More 
0 I 



***Figures represent the actual number of respondents choosing each alternative 
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18. How would you rate the general quality of the Career Education Program staff? 



19. 



20. 



22. 



23. 



ERJC 



Pobr 



Excellent 



0 



0 0 55 45 

1 2 3 4 5 - 

How would you rate husiness and community resources available in the Career 
Education Program ? , ^ 

t 

Excellent 



Poor 



0 



0 

~"2" 



0 

~3' 



30 



~7"0^ 
" 5 



How would you rate your ove'rall rolatioflship with the staff of the CarecT 



Education Program ? 

Poor 

0 



17 



35 



Excellent 
43 



12 3 4 

21. How would you rate the enthusiasm of the Career Education Program staff ? 



Poor 

0 
1 



18 



Excellent 



82 



Wliat do. you think of the occupational plans of your daughter or son ? 

if 

a. ^ There aren^t any firm plans yet. 

b. The plans should be changed. 

c. &S The plans seeny to be good. 

d. fiJ We haven* t really had^ a bhance to discuss the plans. 

What do you thinl^your sun or daughter will be doing a year ;iftcr high school ? 

a. 5fil Working 

b. Attending some kind of college 

c. ^ Going to a business or trade school 

d. [s] Military 
U Other (please specify) 
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V 



24/ Below arc listLcl vai-iou.s areas of possible importance for vounp nooplc to learn. 

' Please rate each in terms of how important you foci it is to learn these thin gs, and" 
■ how well vou feel the program is accomolishing. each . 





1 

a t 

f 

t " 1 


ll(>\v (niportiint 
You Keel This 
Learning Is? 


Do 

\ 

i 

i 


Jit>w Kffeclive Do Yon 
fljbel the I'rojecl Haw 

Been in Accomplishing 

This Learning.? 


Students learn to; 


Not 

Impor- 
tant 
I 2 


3 


\ 

Highly 1 
Impor- j 
tant • 
4 5 




Not 
Effec- 
tive ' 
1 2 • 


3 


Highly 
Effec- 
tive 
4 5 


a. 


Perform specific occupational skills 


0 


0 


16 


20 


64 




0 


4 


26 


22 


48 


b. 


Be punctual and organize , their time 


0 


0 


0 


16 


84 i 
i 




0 


13 


25 


38 


25 . 


c. 


Assume resi>onsibility for themselves 


0 


0 


0 


4 


96 




=0 


4 


25 


38 


33 


d. 


Make decisions and follow through 


0. 


0 


4 


4 


92 




0 


8 


29 


21 


42 _ 


* e. 


Communicate with 'others in a 
mature way 


0 


0 


n 
U 


16 


S4 




0 


8 


A 
*x 


42 


46 


f * 


Be aware of more career 
opportunities 


0 


0 


4 


2/1 


72 




0 


0 


8 


25 


67 


g- 


Work with others ^ 


0 


0 


0 


IG 


84 




0 


0 


8 


46 


46 


h. 


Evalute their own work 


0 


0 


4 


40 


56 




*0 


9 




32 


36 


i. 


Perform basic academic skills 


0 


0 


8 


20 


72 




4 


8 


25 


2t 


42 


j- 


Think through and solve problems 


0 


0 


4 


4 


92 




4 


4 


17 


35, 


■ 1 




Have a realistic attitude toward self 


0 


0 


0 


24 


76 




4 


0 


21 


33 


42 , 

1 


fl. 


Have a positive attitude toward work 


0 


0 


0 


12 


88 




4 


4 


13 


33' 


46 : 

1 


m. 


Have a positive attitude toward 
learning 


0 ' 


0 


4 


8 


88 




4 


8 




29 


1 

46 


n. 


Prepare for further;, education 


0 


0 


20 


20 


60 




4 


4 


29 


29 , 


'33 • 


0. 


Improve interpi-rsonji! and .social skills 


0 


0 


12 


28 


60 




0 


4 


21 


38 ; 


38 

1 i 


p. 


Other rplerise .specify) 
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25. How did vou first hear about the 'Career Education Program? ~ 

—Notice from high school (6)*** 
—From child (lO) 

—From fornicr (CIt:)2 students or Ihoir rt'lativcs-(;i) 
-Other (3) 

26. What kind of students do vou think bcnofit most from Career^ Education Programs? 

—Student not happy in a regular high scliool (9)*** 
—All kinds, (7) ' 

—Students unsure of themselves or who need individual attention (4) 
—Self-motivated, students who want to learn (4) 
—Other (2) 

27. What problems, if any, has your son or daughter encountered in the Career 
Education Program? 

—Managing freedom and getting work done (7)*** 
—Personal (2) * . 

—Getting interesting job sites {2) 
—None (12) 
—Other (4) 

28. If problem t> were listed in answer to the above question, h ow effective do you 
feel the staff was in helping to resolve thes e problems? 

Not "^ghly 



E 



Tectlve Effective 
0 0 6 38 56 



N=15 



29, What types of knowledge > skills or attitudes has y our son or daughter acquired 
in the Career Education Program that vou fe el he or she would npt have gotten 
from a regular high school ? 

— Specific competencies/skills (4)**=^ 

—Confidence in self and abilities (5) 

—Knowledge about different vocations/on job training (8) 

—Better exposure to working and dealing with people" (9) 

—Personal attention (4) 

—Other (2) , —None (2) 

30, What changes, if any, would you recommend for the Career Educati on Program? 
* —Be more demanding/organized (5)*** 

— Expand (scope and number of students) (2) 
— None (7) 
--Other (5) 



♦♦♦Figures represent the actual number of respondents choosing each alternative 
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Appendix E 
(CE)2 EMPLOYER OPINION SURVEY 



Name of respondent^ 
Title of respondent^ 

Name of company 

Type of company 



Address of company^ 



Number of Employees 



Number of employees in the company 





1-10 


11-25 


26-100 




40 


22 


16 


site 


52 


25 


13 



22 
10 




=6C 



Length of time, respondent has been participating with (CE)? 9.5* months (n^ 

1. When the student is on an exploration or learning level at your site, approximately 
^how many hours do you typically spend with the student? (Man-hours per week) 




Number of hours for exploration level 5. 9* fe j Hours for learning level, 6,0* ^ 



2, Which of the following supportive services do you (or others at your site) 'provide 
for the (CE)2 students? Check each appropriate category . 



Do you talk about job^ opportunities? 

Do you talk about the students personal problems? 

Do you talk about activities at your site? 

Do you tutor in ^in academic area? 

-Do you evaluate individual student's assignments? 

Do you assist students in non-job-related assignments? 

specific 



Do you'superviso students to perform a 
job-related task at your site? 

Do you help plan student assignments ?| 

Other {specify)_> 



Exploration 
Level /-"x 
^=60 
32+* ^ 


Learning 
Level 

61** 


28 


41 - 


83 


78 


8 


37 


30 


83 


13 


32 


32 


85 


27 


G7 


3 


5 



♦average number . . /icx 

**all numbers are percentages of those responding unless stated otnenvise 'i -« 



How do stU(k-nts spend ihoir time at your site? Indicate the approxim ate riuinber 

of hours per vvec-k for r.ich cnlmu^y. If they are doiriK more th an one thin^ at 

C he same time, split the hours. , 

' ~ ' Exploration U'arninfi 

Level . Level 



Observing site activities 
Researching from site materials 
Actively performing site activities 



NO VALID DATA 
FOR THIS QUESTION 



Talking with me 

Talking with other site personnel 
Individiml study 

Other (specify) 



4. How did you bel'ome involved with (CK)9.? Check appropriate rcsponsc(s). 



51^ (CK)2 personnel eontactcci me about the program 
3 A student talked lo me about tlie- program 



1 Another employer talked to -me about the program "~ 
5 ' C'ompany 'personnel talked to me about the program 
7 Other (specify) ^ 



5^ VVIiy did you become involved with the prograrh ?- 

—Thought we could help students/worthwhile program (62) 
—Felt participation was of mutual student-industry 'benefit * (11) 
—Service to community (5) 
—Asked to be involved (11) 
— Othdr (9) 
' —None (2) 
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♦represents the number of employers choosing each response— some respondents 
chose more than one option 

E-2 . 



6. 



7. 



8. 



Did the (CE) 9 staff provide you with enough information to help you to direct 
student activities at your site? 



80 



20 no 




=6^ 




^ If you answered no. what information would have been helpful? 

--Problems understanding my function (5) 
"--Problems organizing and coordinating with (CE)2 (1) 

—Other (10) —None (3) 

Would you recommend to a potential employer or resource person that he/she 
also become involved with the (CE) g program ? _ . tJN=t>^ 

—Yes (100) . Why . ~(CE)2 program is worthwhile (2G) 

—No (0) . . —May be of mutual benefit for student and institution (19) 

—May be pf benefit to institutiun (7) 
—Other (17) 

D escribe the type of person you think should be involved with (CE) 2 students. 
—Willing to give time and help (9)* —Like working with young peopio (12) 

—Knowledgeable about jobs ,(9) T —Other (12)* 

—Has extra time for this (5) - —None (2)' 

—Able to teach students/personable (13) »^ 



To what extent has {CK) o had an impact on the following -items ? 

" ^^oy^ Much Impact 



a. Quality of work performed 
by regular employees 

b. Amount of work performed 
by regular employees 

c. Company 1ii ring practices 

d. Company training praetices 

e. List other possible impacts: 



^3o) 



66 



26 



60 



26 



10 



76 



20 t 



58 



27 



10 



II 
II 
II 

n 
II 

M 

II 
II 
II 
II 

11 
II 
II 
II 
II 
II 
II 
II 
II 
II 

II 
II 
II 
11 
II 
It 
II 
II 
II 
II 



Value of Impact 
Don't 



50 



Good 


Bad 


Impact 


Impact 




^4) 


45 


5 


54 


12 


33 


0 


59 


.0 















35 



66 



41 



♦represents the number of employers choosing each response--some respondents 
chose more than one option 



ERIC 



E-3 



10. In general, do >ou thiiik (CE) <? students you have worked with are really interested 
in your site ? Circle the appropriate number from 1 (definitely no) to 
5 (definitely yes) . 



Definitely Definitely 
NO ' YES 

I) - 18 112 25 20 



1 2 3 4 5 

11. In {general, do you think the (CE) ?. students you have worked with are really 
interested in the (CE) 9 proi;ram ?^^ 

Definitely ^ Definitely 

NO ' YES 

0 4 •: 24 41 31 



12-345 
12. How have employees at your site reacted to participation with (CE) ^ ? Check one. 

- 40' Positive reaction * _3 No reaction ^< 

V 2 Negative reaction _5 Not aK>licable /(j|^=6 

40 Mixed reaction iO Don't know 

12. In what ways (if any) have the jemployees at your site benefited? Check one 
or more appropriate responBe(s) : 

18* - They haven't benefited 

29 Increased their awareness of youth ^ 

1 Motivated the 'regular employee^ to further training 

7' Reduced their workload 

7 Increased interested in their own work 

5 I don't know . 



11 Other (specify) 



14^ Do you receive \adequaU' feedback about what happens to the students after they 

leave your site^^ Circle a nuniber from 1' (never) to 5 (alway"i)^ 

' ' Never ' " . Always 

3() 30' 21 4 9 



1 2 3 4 5 

15. Do you receive adequate feedback about the effectiveness of your work with the 
students? 



Never Always ^ 

18 37 10 12 ItJ 

1 2-3 4 5 



^represents the number of employers choosing each response --some respondents 
chose more than one response 




'2 tr ? 



nrlow arc'listt'ci vorioiis .ircas of possil)l<' tmporUuico for younp; poopU- to Icnrii. 
PlcMSf raU'Tnoh in U-rnis of how importnnt you tv.v\ it is to learn th t-sr tliiiit^s, and 
how well you feci the Dro(4rain is acconip lishing each. 





How Important Do 
You Feel this ' j 
Learning Is? ; 

i 
1 




How Effective Do You 
Feel the Project Has 
Been in Accomplishing 
This Learning? 


students learn to: 

a. Perform specific occupational skills 


1 

NOC xiigniy 1 
Impor- Impor- 
tani \^ 7 lant 
1 2 3 4 5 




"NTnf Hiirhlv 
Effec- Effec- 
tivp V-'^^ tive 

live; V J 1/1 V 

1 2 3 4 5 


7 7 28 15 43 j 




0 10 40 83 18 


b. Be punctual and organize their time 


6 0 4 26 64' 




9. 21 2S< 28 14 . 


c. Assume responsibility for themselves ' 


4 0 4 20 72 


2 8" 34 32 22 

- < 


d. Make decisions and follow through - 


2 2 : 6 22 67 


5 15 43 20 17 


e. Communicate with others in a . 
mature way i 


4 2 5 25 ■ 64 


2 7 24 '41 24 


f. Be aware of more career 
opportunities 


2 4 ^4 28 43 


0 5 19 36 40 


g. Work with others 


4 2 2 27 65 


0 2 24 43 31- 


h. Hvalute their own work 


2 4 17 37 41 


0 11 55 24 11 

1 


1. Perform basic academic skills 


5 5 22 33 35 . 


5 11 45 34 5 


j. Think through and solve problems 


2 5 5 31 56 


2 < 7 49 34 7 i 

- 1 


k Have a realistic attitude toward self 


6 2 11 15 66- 


1 

2 5 28 52 13 , 
. — =^ 


K Have a positive attitude toward work 


4 2 5 24 65 


5 8 28 42 17 : 


m. Have a positive attitude toward 
learning 


4 2 2 29 64 


0 3 33 50 15 


n. Prepare for further education 


R 22 40 27 


5 10 38 33 14 


0. Improve interpersonal and social skills 


4 4 25 31 37 


3 5^ ^7 27 18 


p. other roleasc sDceify) 
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ERLC 

1 



17. 



How manv.times and ways have vou communic ated with staff during this school 
ycarV ,Check as many as apply > ^ 



Almost evi?ry day 
Once or twice a week 
Once or twice a month 
Less, than once 'a year 
Never 



Individual 
Meetings" 

3« 



Group 
Meetings 



*10 



Telephone 
3 . 
13 



Correspondence 
0 
0 



22 



19 



24 



17 



18. Do you plan to continue participating with (CE) 2? 



94 ' yes 



no 



19. 



20. 





=4J 




=641 



21. 



WHY? V^-s 
— Project is- worth>vhll^ X50j) 

. Like the idea and people =6f-*(eE}-2^ (7) 

—Challenging to me (5) ^) 
—Community service (7) 
—Staff problem . (5) 
—Other (23) 

—No response (3) j" 

What. do you think are thb greates t strengths of (CE)?? 
— (€e)2 personn'^i /organization (19), 
—Good alternative to high school '^3) 
—Help students learn aUout variety of careers (11) 
—Help student learn aj^ut "real life" situations (11) 
—Other (20) """^-''^ 
—No response' (16) 

. What do you think 4re the greatest weak nesses of (CE)2? 
—Some students can't handle the freedom (25) 
—Problems in organization (28) 

—May not provide sufficicflt coursework for chosen profession (5) 
— fJeeds more time nn job site (5.) 
—Too much paper work (5) • . 

-Students are not receiving sufficient training (5) 
j^*er__(20) —None (7) 

How manv students would your site be able to handle at one timf- for nn explorntion 
level? 




— Number of students: 
— % of employers: 



8 



61 



19 



♦represents the number of employers choosing each response 
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22. What do you soc as the primary factor(s) limiting the number o f students your 
site vouUl adociuntely handle'^for an exploration level? (For example, limited 
spaec, sup<;rvisory personnel, available equipment, etc.) 

—Space/equipment (24)* 

~Personnei--miBht disrupt otlifer workers (2fl) 

—Lack of timo to work with students (5) —Other (6) 

—Problems in inM)Iem(MUin{»'^pro{»r:im . (G) —None (1) 

23. To what extent do you foel you were able to identify student deficiencies in basic 
skills such as readine and mathematics ? 



Not at all 
able 



15 



13 



31 



Very 
able 

26 15 



24. 



25. 



26. 



How 


do 


a. 


31 


b. 


Q 


c. 


8 


d. 


55 



Handle it myself 
Refer student to program persbi 
Consult with program personnel 
There have been no problems 




What do you feel students are able to learn on job -sites that they could not 
le arn as well in a regular school classroom ? 

—First-hand knowledge of demands of a realistic situation (52) 
—-^Working.jvith other people (14) 

--Self-discipline (8)- 

—On the job activities (14) > —Other (12) 

Wh at other: comments or recommendations about (CE) ^ would you like to make ? 

—Doing a fine job (29) . 

—Better organization with employers (IG) 

-r-Change the experience at employer site (10) 

— Better screening nnd training of students (19) 

—Other (10) * " ^ 

—None (7) - - 





♦represents the number of employers choosing each response— some respondents 
chose more than one response 



THANKS FOH YOUR TIME IN COMPLETING THIS SURVEY 
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Appendix F 



PROJECT DIRECTOR QUESTIONNAIRE 



Respondent Information . * 

ilame Rex llagans and Jerry BeicE- 



Positio n Program DirGctor and (CE)2 Project Dic^ctor 
Organization NWREL and (CE)2 - ".1 



This questionnaire is designed to obtain common program data 
for the four Extaerience Based Career Education (EBCE) projects, 
some of. this information is already available but not in a common 
format; the rest is new information. 

This information will be used as a partial description of the 
projects for the March Interim Evaluation Report, as background 
information for the R and D Monograph, and for -other public re- 
lations purposes. 

Unless otherwise specified; the time period for use is the 
current academic year (1973-74) , 

Would you please give one completed copy to your Evaluation 
TDTrector-and-s^end one copy to me, preferably by February 27, If 
you have any questions Or comments, please call^Mary Ann Millsap 
at 202-254-5054. * _ ^ 



FULL-TIME STAFF MEMBERS 



STAFF 



1. In the boxes below, please list every member of your profession- 
al staff in one place only. Indicate the number of staff in 
each category and indicate the percent. of time spent in contact 
with students. \Jhere more than'' one staff member is listed per 
category, pl^se indicate the average percent of tim,e spent in 
direct con.tacr.^i-th students. 



• 

POSITION 


NUMBER OF FULL-TIME 
STAFF** 


PERCENT OF TIME . 
SPENT IN DIRECT 
CONTACT XVITH 
STtJDENTS 


(Learning Mahager)^ 


2 


see main body of 
Evaluation Report 


(Student ^Coordinator) 


1 


for information about 
operational vs. 


Aides 


1 


developmental time 
allocations. 


(Project Director) 
Administrators 


1 




Evaluation boeciaxisuis 


none 




Curriculum Specialists 






Employer Relations 
Specialists 


2 




(Learning Resources Specialis 
L ibrary/med i a 
Specialists , / 


) 

1 . 




Clerks/secretaries 


1 




Other (please specify 
below) Prolect Assistant 
Van Driver 


1 
1 




*TOTAL FULL-TIME STAFF 


11 





ERIC 



♦Should match number of persons assigned to contract, excluding 
part-time positions. 

**This question does not accommodate the unique organizatioijal pattern employed 
at (CE)2 which provides that operations and design are both "hats" that 
professionals, must wear. NWREt staff are not shown here. See attached 
organizational chart. ■ ^"^ 



' * PART-TIME STAFF MEMBERS 

2. Complete this chart in the same manner as the one above. In- 
dicate the number of» staff in each category and indicate the 
percent of time spent in contact with students. Where more 
than one staff member is listed per category, please indicate 
the average percent of time spent in direct contact with 
students. , 



POSITION 


NUMBER OF PART-TIME 
STAFF 


PERCENT OF TIMb 
SPENT IN DIRECT 
CONTACT WITH 
STUDENTS 


Learninq Coordinators 


none 




Counselors 


none 




Aides 


none 




Administrators 


none 




Evaluation Soecxalists 


none 




Curriculum Soecialists ^ ' none 




i • ' . 

Employer Relations 1 

^ . , . . ^ ) ' none 




Library/media 
Specialists 


none 




Clerks 


none 




Other (please specify 
below) 

Tutors 


by the hour 




TOTAL PART-TIME STAFF 
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For those professional staff who are in direct contact with 
students at least 75 percent of their time, please indicate 
how many: 

Number 



c. 



a. Are certified public secondary school teachers 

b. . Have previous teaching experience in secondary 

schools 



Have previous experience in innovative or 
alternative schools 



d. . Have previous experience in individualized in- 

struction ^ ^ ' 

e. Have previous experience in interdisciplinary ^ 
or team- teaching — 

f. ^ Have accredicted private school 'credentials ^ 

. 2 

g. Are certified guidance counselors _ 

h. Have, as' highest degree earned, a Bachelor's ^ 
Degree ^ * 

i. Have, as highest degree earned, a Master's ^ 

^ Degree . "-^ — . 

j. Have as highest degree 'earned, a Doctorate ^ 

Degree ' 

If you had an additional $25,00,0 iJ personnel salaries, where 
would you put it (re both professional and clerical needs)? 

For the entire program (both (CE)2 and NWREL), I would pu t it into 

the writin g - product preparation function. However, if per pupil costs 

were not a factor, I wojdW add learning managers^ ^ 



EMPLOYER CONTACTS 



For each of the following three 
questions, please checlc the 
appropriate frequency. ' 
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5. Approxixnately how often are 
students' observed by a 
representative of the program 
during Level I experiences? 

(CE)2 term: Exploration Level 

6* Approximgitely how often are ^ 
students observed by a 
representative of the prograini 
during Level II experiences? 

{CE)2 term: Learning Level 

7. Approximately how often are 
students observed by a 
representative of the program 

during level III experiences? □ □ D O D 

(CE)2 students have not as yet chosen Level III: Skill Building 



□ a □ □ □ 

Initial explorations are visited- 
as students become more 
efficient, none are visited. 



□ □ □ □ □ 
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I, 



8'. 



DO §tudents keep a time card or sign- in , sheet ■which is 
signed off by their employer (s^? • 



Level I 

a. (ZD Yes 

b. HDno 



Level II 

a. [3 Yes 

b. D No 



Level III 

r 

a. dl .^es 



students keep a log of what activities they engage, in on, 
a\ daily or weekly basis? 



Level I 



Level II 



Level III 



b. 



JLYes 
Zj No 



a. ! ^ ! Yes 



b.n 



No 



b. 



Yes 
No 
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11. 



Are ind;ividual oroject assignments given to students approved 
in ad\i;ance by the employer? 




Level II 

a. B Yes 

b. □ No 



Level III 

a. ; .[ZD Yes 

b. □ 



No 



/ 



Are individual project assignments comoleted by students approved 
by employe?^ in writing before the ^-^udents are cpdited with the 
work being completed? / ,' 




Level/ II 
' a . ^ Yes 



b. 



No 



Level III 
a. n] Yes 
ib. CZ! No 



* portions of the project are approved 
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12. .How many written performance appraisals do employers typically 

complete for students during the course of each of the follow- 
ing levels of experience? 

Level I Level II Level III 

a. none a.CZlone a.CZ]one 

They must b.EZ] 2 or 3 b. E 2 or 3 b. □ 2 or 3 

certify 

exploration c.CZlMore than", cIZUMore than c. ill] More than 
package three three three 

accuracy. 

d . EZ] None . d . CZl None d . i 1 None 

13. Approximately how many hours per week are students involved in 
the total program? 30 is the ta rget. This varies by student— some exceed. 

14. What is the approximate break down of time at employer sites 
and time at , the program site? 



\ 

\ 



Percent of time at program* 
site? 

Percent of time at employer 
site? 

Percent of time in other 
activities? . 



V 

/ 

Level I Level II Level III 

49% 49% 



38% 38% 



13% 13% 



Total 100% • 100% 100% 

If this varies for different grade levels of students, please 
explain below. 
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15 • How many students have completed at least one: 

45 (most have completed 3 or more; 5 new 
Level I experience students compiete d 0) 

Level II experience all students are on ongoing site's 
Level III experience 

STUDENT SELECTION 

16. What were the factors considered in selecting students for 
your program? Please describe below. 

We ha ve accepted most volunteers, although we" have attempted 

to increase the number of ''self directed" students in relation to the total 

student body. 



17 : How many students are currently enrolled in the program? 

Part-time students ^ 

Full-time students 50 

18. Were you able to accept all students who applied for the prog 
this year? 

a. I I Yes 

b. HNo 

19. Was your planned enrollment 

a. HMet 

b. [ZD Not met 

c. I 1 Exceeded 

By how much? + ^ • 
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20. What enrollment do you anticipate next year at this time? 

CREDIT ASSIGNMENTS 

Describe the process by which students are granted academic credits 
for individualized work .assignments . 

21. Who decides what assignments should contribute towards academic 
credit? 

XK< ^Gareer education program personnel 

" School district personnel 

Both 

" Other (please specify) -1 — 



22. How is it decided how many credits should be awarded and in 
what subjects? 

Staff members translate program experiences ir)to recommendations for 
credits—no credit awards are made directly. 



23." About how many hours of work constitute a single unit of credit? 
About hours 

ftDuui. ^^gg j^Q.^, APPLY 

No set number, but usually varies 
from to _hours 



:;4, 



o 
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;.oes anyono outside '^f the proqrain review 'the academic credits 
'/Jhich hav(2 bo^'U awarded students fon completion of different 



ass ighmen *:s ? 



Local school district - personnel - 

- \ 

State school personnel 
Adviijory. committee 
lEJnployers 

External curriculum specialist* (for sample of students) 
Other (please specify) ^^^Ll 



-:5. What school's name is on the student's, diploma? 

c 

Career education program 



L ocal high school ' 
XXX other (please specify) CcTlificnU- iilso given by (( K)c> 
What different types of diplomas are granted? 
XXX Only one diploma for all students 

^Academic 

3u s ine s s 

V ocational 

\ 

General 



G.E.D. (i^^vi r,KI) [I'om other agoncy) 
Other (please specify) 



If more than one, what Sre the differences in requirements 
between thorn? 
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Have there been any ' problems about getting colleges , .. the State, » 
or oth^r in&ta tutions to recognize credits/diplomas granted 
bv the program? 



a . i : Yes 



b , [BJ Nc • • 

If ves, please explain. ' 



Have some studontr, dropped out of the program voluntarily since 
September 1973? 

- ■ a . IZIl '/es 
b.!ZjHo 



If yes, please indicate the nvunber of instances for each of the 
reason^ listed belov. 



Number of 
instances 



7 

student un'wxll.^ng complete 
program assignmem:: 

Student unhappy ^ith program 

Parents unhappy wxth program 

Reasons beyond s'zudent's control 
(e.g./ family moved out of 
district) 

Other (pleaiJO npecr>fy) aoL marriod a nd lofl lown 
Wanted to ' Uini Id hml school 
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i 



yes, how Long on the average did they stay in the program? 



If yes^ what did tlie students do after leaving the program? 

Ntmiber of 
instances 

— J 

Returned to regular high school 5 

Joined the military . ' j 

Obtained a full-time job ^ 

Nothing ^ 

^ther- (please specify) nrarricd . ^ 
ran away from no^.w I 



Have some students been involuntarily terminated from the 
program since September 197 3? 



a . Yes 

b. IZZl No 

If yes, how many? t^wo 



On the averacre, how long did they stay in the program?_ 
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If yes, please indicate the number of instances for each of 
the reasons listed below. 



Unwilling to complete program 
assignments 

Inability to do program work 
Disciplinary problems 
Excessive absences, latenesses 
Inappropriate dresb 
crime 

Problems wi.th employers 
(please specify) - ^ 



Nxamber of 
instances 



/ EMPLOYERS 

30. Approximately how many employer/resource persons have accepted 
students for Level I experiences-? 74 

31. Approximately how many employer/resource persons have accepted 
students for Level IT experiences? 33 ^ [ — 

32. ApproximaL-_-l'' how i Any employer/resource persons have accepted 
students for Level 111 experiences? 0 

33. Are employers reiml.Mrsed for any expenses incurred because of 
the program? 

a . dl Yes 

b. IZ]n<j 

If yes, plea.'ie exp3 lin and give approximate amounts 
)i( rnv lasl -.ear- -iv lit 'Irs year 



I 
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34 • Have any employers requested that students be dropped from 
their* wor!; site? 



ERIC 



a* lEZ Yos 



No 

If yes, how many J_ 



If yes, please check the reasons. 
a.Cj Student dress 



b* LiLi Behavior towardi; regular employees 

c, i Behavior tov^^ards customers 

d. | i Behpivior tov>;ards other student,s at site' 

Latenesses/absences / 

f . CZ] Tlieft 
I 1 

i i Safety violations 

h.'i ! Insufficient, training 

Inability to handle tasks 
j.Q Other (please specify) disinterest 
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35. 



36. 



37, 



Do students ever perform tasks that would otherwise have to 
be assigned- to a regular employee?' 



Level I 



a . IJ^J Never 
Rarely 



Sometimes 
d* ; ! Frequently 



Level II 

Never 
1 i Rarely . 
Sometimes 
Frequently 



Level III 

a, 1 J Never 

b. □ Rarely 

Sometimes ' 

d, [ 



^ Frequently 

Have any students been paid for work done as part of th^ program? 
Level I Level II Level III 



a . • Yes 

b. \Kj No 



a • 



Yes 
b. [ZD No 



a . . . Yes 

b. [ZJ No 



Have any students in the program been hired by employers for 

work on weekends, siommers, or after school? 

P — — • -ft 

a- ULJYes 



b. i I No 

If yes, about how many instances have there been of this?_ 
many— 20 lo 2U ^ 



"^o emTji«»y ceivu any training regarding their role in the 

orocram ^'»"e students are sent to them? 



:e.s 



b. L__' No 



If yes, about ho\- m;*ny hours of training? 



hours per year 
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Have informational materials been developed which' explain to 
employers their role in the prografa? 

a. CD Yes . , 

b. rZl No 

HOW many employers have dropped out of the program? H 

ChecTc the reasons given by employers for dropping the program. 

Number of 
instances 



Decline in b'tidness 

» * 

6 

program toe time consuming — _ 
Program too expensive . 

0 

Complaints from customers 

0^ 

Union problems • 

problems \vith students 

Business under new management L 

involved in 

other (please snecifv) other care er ed progranis_i 

unknown 



-iv.e become involved with the program?. 



'nTes'p''' i/ply. .xfL-pt that "the Board of Directors includes 3 labor representatives. 
HOW nany .mi-^ acc serving as learning resourses for 
stuc'e its? 



Level L 



L 



Level TI 1 Centr al Labor Temple 



i 
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ADVISORY BOARD 

43. HOW many persons from each, of the following grorups'are re- 
oresented on the advisory board? " - . , 

The {CE)2 Board ol Directors is legally responsible for the program. 

Number of Representatives 

Employers in program . 1 

Employers not in program . — II 



Union officials at plants • in 
program 

U^nibn officials at plants (or 
lacais) not xn/^rogram 

Political figuires 

School administrators 

Parents ^ 

Other (pleaae specify) students 
coirimunity representative 
school district representative 



44. How often does tl^e advisory board meet? 
a. I i Weekly \^or more often 

' b- * ! 2 or 3 times a month 

H^^^,, \ The Board meets monthly. A number of 

Mont Hi y \ ,11 
\ advisoi7 task forces meet as needed • 

Quarterly 
Annually , 
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ADVISORY BOARD 



43. HOW m^ny persons from each of the following groups ' are" re- 
presented on the advisory board? 

i'he {CK)2 Board, of Directors is legally responsible for the program. 

Number of Representatives 



Employers in program _i 

Employers not in program Zl 

Union officials at plants in 

program 

Union officials at plants (or ^ 

locals) not xn program 

Political figurt^s 

School administrators 

1 

Parents _ 

Othe'r (pleaae specify) students^ 1 

eommunity representative 

sehool district representative / - 



r 



44. How often does the advisory hoard meet? 

a. CZj Weekly or more often 

b. i ! 2 or 3 times a month 



c 



H Month ^^^^^ ^^^^^ montbly. A number of 

advispi7 task forees meet as needed. 



Quarterly 
Annually 



) 
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45. 



46. 



Does the advisory board have subcommittees or special interest 
groups that meet at other times than the regular advisory , 
board meetings? 



Yes 



No 



Please check those roles that the advisory board has re the 
following program components. 



Program operatJb^ns 
Curriculum development 
Graduation requirements 
Other (please specifV) 



bcrsonncl, transportation \ 
corporation rchitidnsliip 
fiscal responsibility 



None Advisory 



□ 
□ 
□ 

/6 



□ 



Determining 
Policy 

a 
n 

CD 
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AiJOW THE NW]?EL/(CE)o EBCU: PROGIUM IS ORGANIZED 



NaLionol Inslilulo- of Education 



Northwest Rc};ional Educalional Laboratory 
1 ,a r ry Fish, Kxecutive Director / 



(Subcohtract) 



(CE)2 Board of 

Directors 
Pat Furrer, Chairman 



Division of Career .Education 
Charles Jordan, Director 



EBCE Program 
Rex Hagans, Director 



Replication Team 
I'ojbe specified 



Liz Gross | 

Administrative Assistant 
Karcn Iljuiiada 
Typist 



Jeriy Bcier 

Executive Secretary and 
Project Director 



Tom Owens 

Coordinator, Evaluation- 



Lariy McCIure 
|Coo rdi nator , P roduct 
Development 



Operations and Design 
. Jewel Kilgour 

Project Assistant 
Sandra Kamfcnberg 

Student Coordinator 
Virginia Thompson 

Learning M imager 
Bill Black 

Assistant Learning Manager 
Duncan Hunter 

Employer Relations Specialist 
Lou Morehouse 

Employer Relations vSpecialist 
Karen Wood 

Learning Resources Specialist 
Dee Martyn 

Aide 
Phyllis Pratt 

Clerical Assistant 
Robert Sullivan 
Van Driver 
NWREL^Development Support Staff 
on Assignment 
Ivy Boslaugh 

Curriculum Coordinator 
Sue Stannard 
Secretary 
t 



Marshall Ilerron 

Evaluation Specialist 
Harry Fehrenl^acher 
Research Assistant 
Kathy Petersen 
Secretary 



'Nancy Anderson 

Writer 
I Alan Baas 
i Writer 
' Marcia Douglas 
Writer 
Paula Taylor 
Secretary 
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Product Development 
Team 
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Appendix G 
STUDENT BACKGROUND DATA 



The following charts display student background information collected 
by questionnaire in September from students in {CE)2> the Cooperative 
Work Experience program, the Tigard High School random samples 
and the Occupational Skills Center sample^ A revicv/ of characteristics 
of students in these four groups is useful in understanding any evaluation 
data presented in this Interim Report, 



V«ri«ble 



Sex 



No. of 
Siblings 



Sibling 
Rank 



Previous 
Employment 



No. of 
Previous 
Jobs t 



Reasons 
for 

Working 



Previous 

Work-Study 

Participation 



Values 



MaJe 
Female 



Oldest 

Youngest 

Neither 



Yes 
No 



11 

N %^ 



osc 

12 Total 

Ji % N % 



31 (!2 
19 38 



3 G 

10 . 20 
15 '30 

11 22 
H Hi 
1 2 



11 23 

17. 35 
20' 42 



35 71 
M 29 



Support Family 
Money for Expensrs 
Experience 
Other 



Previous 
Job 

Awareoess 



Yes 
No 



In School 
Outside School 
None 



5 13 

18 45 

13 . 32 

3 7 

1 2 



32 91 
2 6 
1 3 
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33 (>(> \v>A 

17 34 jnr, 
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1 2 « I 4 
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7 

8 



I 

-r 
2 « 
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29 35 
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4 5 



3 H 1 20 
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19 ! M 



13 
9 



2G 54 } 13 



2G 
28 



20 
IG 



4G } 40 



27 
23 

f)0 



11 

N % 



TlISi 

12 i'otal 
N % N % 



15 60 
10 40 
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4 18 
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12 50 
12 50 



1 4 

3 13 
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5 21 
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2 8 5 10 
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7 
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12 
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2 8 
12 48 
11 44 
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G 2 



-I 
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12 



12 



7 35 
4 20 
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8 53 

3 20 

3 20 

1 7 
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2 13 
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14 93 



3 14 

4 10 
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3 10 
24 77 
2 6 
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4 13 
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STUDENT liACKGROUNl) DATA continued 
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9 Professional 


1 1 

2 


22 
4 


K 
7 


Mi 1 
14 1 


19 
'> 


19 
9 


2 
2 


9 
9 


2 h 

r> 21 


1 * 

i 7 


9 

ir> 


4 17 

2 H 


3 
2 


M) 
11 


( 3 
I 


10 
13 


« 

» 4 


12 
10 




10 proprietor 


4 








4 


4 






1 4 


! 1 
i '* 


2 
4 


4 17 


1 


f) 


1 1 

* 


4 

G 


1 2 
j 2 


5 
4 




1 1 Protective »Ser\ ice 


I 


2 






1 


I 


1 


4 


1 1 






^\ 4 














12 Sales 


5 


10 




18 1 


14 


14 


2 


i) 


3 13 




11 / 


2 


11 


» 3 


10 


, 5 


10 




13 Service 


1 








1 


1 






1 *1 


» 1 






1 














14 Technical 


2 


4 


1 2 


•1 1 


4 


4 


3 


13 




! 3 


fi 


t 






} 1 


3 


1 1 


2 




NIK Catej^orie.M 


1 

r 






















j (i 20 


\ 


20 




10 




13 




1 Clerleal 


1 


17 


* 9 


19 i 


17 


18 


K 


35 


* 3 14 


* 11 


25 


! 


^ 7 



Mother's 
Occupation 



2 Craftffinnn 

3 Karnirr 

4 Homeniaker 
Lal)Orer 

G Manager, Admnstrator 

7 Military 

8 ()|X'rative 

9 Pcofesfiional 

10 Proprietor 

1 1 Proteetlve Service 

12 Sales 

13 Service 

14 Technical 



J 2 
2^ GO 
2 4 





4 1 4 H i 


2 


4 ' 4 H 


1 


2 1 2 'It 



\ 22 


47 


50 


50 


j 1 


2 


1 


I 


1 2 


4 


4 


4 



12 52 



1 4 
I 4 

I 4 



1 5 1 



15 71 



) 



1 5 



iGl 
2 



I 2 
1 2 



10 43 I 9 45 

1 4 j 4 20 

. -I 

2 9 I 2 10 
1 4 ! 

1 4 i 

1 • 



14 45 



2 
I 
I 

G-2 



23 44 



^ 1 


6 


12 


6 1 


2 


4 


G 1 


4 


8 




1 


2 


6 ! 


2 


4 


3 > 


1 


2 


3 I 


1 


2 



ERIC 



STUDENT BACKGROUND DATA continued 



Variable 



Values 



No. of 
High School 
Activities 
Last Year 



No. of 
High School 
AcUvlUe^ 
This Year 



No. ^of 

Community 

Organlzptlone- 



No. of 

Current 

Hobbles 



FKnjoy 
Reading 



No, of 

Books 

Read 



Newspapor 
RetdiEig 



Newspaper 

Sections 

Read 



0 , 



No 

Sometimes 
Usually 



0 

1 or 2 
3-5 
6-10 
11-20 

20 or more 



Never 

Bi-weekly 

Daily 



Ethnic 
Background 



11 



()SC 
12 

N '\ 



Total 
N '\ 



18 
18 

10 20 
3 n 
1 



30 * 15 30 I 33 33 
364-2^- A4^J„4(LjlO 
y 18 t V^ 19 



I 



\ 



2 > 
I 

i 

— 



17 34 [28 

IC 32 i 14 

13 20 I 6 

2 4 12 

2 4 1 



50 ' 45 
28 ! 30 
12 ' lU 
4 

! 2 



45 


10 


40 


30 


9 


36 


1!) 


1 


4 


4 


3 


12 


2 


2 


8 



1 — 

41 82 137 
8 16 j 11 
\\ 2 I 2 



Sports 

Fashion 

Front Page 

Comics 

Editorial 

News Columnist 

Other 



White 
Black 
Oriental 

Spanish Sumam(* 
American Indian 
Other 



— t 

2 4 ] 3 
(J 12 I 5 
14 28 I 12 



74 I 78 78 
22 I 19 19 
4 8 3 3 



I 



15 



I 



30 I 16 
II 22 I 11 



I 



5 

10 j 11 

24 [ 2(i 
32 I 31 
22 » 22 
4 I 4 

I 



9 18 ' 3 0 I 12 12 
27 " 54 j25 50 j 52 52 
14 28 "22 44 I 36 36 



3 0 I 2 
12 24 I 0 

11 22111 

12 24-1:12 
^9^1 8 I 0 

0 I 13 
1 



3 



10 20 ; 0 

24 48 I 23 
16 32 i 21 



I. 



12 ,10 10 
46 I 47 47 
42 I 37 37 



J9 98 j 48 



00 j 97 97 



11 

N % 



THSl 

12 rotal 
N '\ N % 



12 48 

4 16 

3 12 
2 8 

4 16 



20 80 
4 16 



5 21 

6 25 
5 '21 
8 33 



3 13 
11 46 
10 42 



I 

4 i 


5 


5 


3 


12 i 






3 


6 


12| 


18 


18 


4 


16 


4 


17 j 


8 


17 


22 1 


22 


22 


, 4 


16 


5 


22 i 


0 


.19 


24 1 


24 


24 


7 


28 


10 


43! 


17 


35 


12 1 


15- 


15 


3 


12 


2 


9i 


5 


10 


26 I 


10 


10 


4 


16 


2 


? 1 


G 


13 



14 56 
11. 44 



22 


44 


i 28 


50 , 50 


50 


16 


V64 


10 


42 ] 


26 


53 


6 


24 


0 


12 


1 4 


8 > 10 


10 


1 


16 


8 


33 1 


12 


24 


4 


16 


30 


72 




90 1 81 


81 


21 


84 


20 


83 


41 


83 


20 


80 


34 


68 


\ 38 


' 76 I 72 


72 


24 


96 


16 


66 i 


40 


82 


.21 


84 


4 


8 


j*13 


26 1 17 


17 


7 


. 28 


0 


25 


13 


27 


.6 


24 


2 


4 


1 4 


8 i 0 


. 6 


2 


8 


5 


21 


7 


14 


3 


12 


6 


12 


1 n 


12 ] 12 


12 


6 


24 


7 


29 


13 


27 


'8 


32 



20 83 



10 42 
6 25 



8 
4 

17 
4 



22 45 
10 20 

~~5^0, 
3 6 
« 10 
1 2 



13 54 
5 21 



4 
4 
13 
4 



[ 23 


47 


23 


92 


i 14 


29 


1 


4 


^ 2 


4 


1 


4 


! 4 


8 






! 

i 1 


10 

2 







20 83 
4 17 



2 


8 


2 


4 


2 


8 


7 


15 


6 


25 


12 


25 


10 


42 


15 


31 


2 


8 


10 


21 



4 17 
10 42 
10 42 



3 14 

8 36 
11 50 



22 96 



CWE 
12 

N % 



18 


72 


9 


43 i 


19 


5 


20 


8 


38 ] 


10 


I 


4 


a 


14 1 


I 


1 


4 


1 5 \ ~ 



40 82 
8 16 



7 15 
21 44 
20 42 



22 88 
3 12 



2 8 

3 12 
5 20 

11 44 



8 32 
11 44 
6 24 



3 6 
22 47 
22 47 



8 32 

8 32 

5 20 

2 8 

2 8 



42 89 



3 12 
14 56 
8 32 



23 02 
1 



<CE)2 
11 12 

N % N % 



Total 

N % 



17 



81 
1 5 
3 14 



18 86 
3 14 



2 


10 1 


2 


6 


I ^ 


8 


\ 


19 1 


4 


13 


1 B 


15 


3 


14 


7 


23 


[10 


19 


8 


38 1 


5 


16 


1 13 


25 


4 


19 


U 


35 


1'^ 


28 



3 
13 
4 



2 
14 
17 

3 
6 



26 
11 
67 
81 

16 
32 



17 89 

1 5 
1 5 



61 I 28 54 

32 j 18 35 

3 14 8 

— ^U-j. 2 

3 11 2 
I 
1 

- — -t- 

84 [ 43 83 

10 I 4 8 

3 6 



I 



Cl 2 

I 

I 
1 

j 



23 74 i 41 78 
8 26 [ 11 21 



3i 1 

3 I 1 
I 



I 



8 -38-T— 4-^3 l12 23 



9 


43 j 


15 


48 


24 


46 


4 


19 1 


12 


39 



16 




31 


3 


14 


2 


6 




10 


7 


33 


6 


19 


|13 


25 


5 


24 


8 


20 


1 13 


2£» 


2 


10 


6 


19 


! 8 


15 


2 


10 


4 


13 


1 e 


12 


2 


10 


4 


13 


! ' 


12 



26 [ 11 21 

42 I 26 50 

32 ' 14 27 
-4- 



42 j 18 35 
19 I 8 15 
$5 [34 65, 
87 ,44 85 
4 
12 

42 !19 35 



6 2 
10 } 6 



30 



100 j47 90 



I 1 



G-3 
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S'l'imKNT BACKGROUND' DATA continued 



Variable 

Father*H 
Education 



Mother's 
Et^iC^tlon 



Value 9 
None 

Elenicniary 
^onie High School' 
High 1 w ^lualo 

Somt- C .1 uRc- 
Coll i,« ' I aduate 
r,raduau» Work* 
Advant-^J Dcgrer* 
Don't Know 



11 
N % 



12 
N % 



1 
J 

5) 
!7 
U1 

1 



2 
IH 

2U 



1.S 

1 



\ 7 J4 



None 

Elementary 
Soni* Htgh School ♦ 
High School Graduate 
vSome roMop' 
i rnilfge Cirailuate 
GraduaU* Work* 
Advanced Degree* 
Don't Know 





1'. 



\ 

3i 
I 



•1 
3(> 



10 



02 



Firet Reason 
for Entering 
Special 
Program 



4 ' 0 



1 Learn about careers 

2 E)tplorc' what I can do 

3 Prepare for j5b 

4 Bored with school 

5 Independence 

0 Choose own learning' 
style 

7 Tired of learning 
same thing 

8 Explbrc job 
opportunities 

9 Other 



23 49 

3 0 



28 



1 1 



11 

15 



4 7 
\U 15 



Second Reason 
for Entering 
Special 
Program 



Third Reason 
for Entering 
special * 
I Program 

! \'- 



() 13 


' 3 




3 


r, I's 


i:! 


24 ' 


!rt 


r, in 


• H 




13 


• 14 


4 




1 1 




3 


r. 


ft 


3 


3 




(> 


^ 10 


^ 3 




V 


30 


, W 


<?/ 


2i 


1 2 


«i 




3 








12 


5 




1 } 




i» 






7 ! i 


>i 






S» 


5 ! 


!(• 






\i 


1 . 


n 








;i 








'1 






14 


10 






1 









ill 

13 
11 

r> 

* t 

21 

3 ' 

'■■I 

•J ' 

\ 

\^ 
M 



\ 4 19 



in 



5 

19 



5 >>> 



16 ^ 6 12 











I'MSi 






CWK 












Total 


11 




12 




Total 


12 




11 




12 


rolal 


N 




N 


% 


N 




N 




N 




N 




N 




N 


1-. 


' 1 
























1 


3 ; 


1 


2 


i 

. 3 




1 


4 






\ 1 


2 






5, 


26! 


7 


23 i 


12 


24 


' Ms 


1(> 


f) 


20 


• 2 


9 


' 7 


15 


5 


21 




1 




I 






34 


34 


9 


30 


' 5 


22 


i 14 


29 


5 


21 


2 


10 I 


t 


23 ! 


9 


18 


2k 


28 


3 


12 


; 4 


17 


1 


15 


5 


2] 




21 1 


0 


20 { 


10 


20 




2 


4 


in 


• 9 


39 


1 13 


27 


3 


13 




15 1 


0 


16 1 


8 


10 


\ 


2 






' 1 


4 


' 1 


2 


2 


H 


1 


t 
1 




1 








2 


2 


8 






1 ^ 




4 


17 




1 




13 ' 








12 


1 


4 


* 2 


9 


^ 3 


6 








_, — ^ 


4 


1 
1 

r 


.'9 


18 

* - 


1 






















1 
i 


5 


IG { 


5 


10 


1 

1 1 


I 














1 




1 ^ 






1 


2 


4 


1 M 


H 


2 




' 1 


4 




6 


1 -1 


17 




1 

\ 




\ 
\ 










14 


56 


' 13 


54 


27 


55 


I." 


33 


5 


25 J 


1 1 


ob f 


1 u 




' n» 


l^i 


4 


](> 


" C 


25 


10 


20 


: 5 


21 




31 ^ 

i 


7 


23 j 


13 


2G 




/J 


2 




. 3 


13 


i 5 


10 


v 


13 


* i 


9 1 i 


2 


n ) 


() 


12 


* 3 




1 


4 






1 


2 




4 




I 
{ 




1 

\ 






















\ ' 


4 
















n 


2 


8 


' 1 


4 


' 3 


G 


» 2 


8 


2 


10 1 


5 




7 


14 


' 10 


10 














7 


33 


A 


19; 


3 


'10' 


7 


13 




5 


















1 1 


5 i 


2 




3 


G 




53 
















14 


^ 3 




3 




G 


12 


3 


3 














' 2 


10 


! 4 


19 I 


G 


19 1 


10 


19 


'» 


2 














. 2 


10 


, 2 


10 1 


4 


13 


0 


12 


1 ri 


2 














I 2 

1 


10 


* 2 


10 j 


•2 


"1 


4 


8 



9 17 







0 


10; 


1 


' 6 i 


4 


H 


: 






10, 


1 


3 ' 


3 


0 


5 


25 


; 


5 1 


8 


2gI 


9 


18 


1 


5 


2 




3 


10; 


5 


10 


2 


1.0 


2 


10 » 


5 


16 1 


7 


13 


1 


5 




1 

10, 


5 


V> I 


7 


13 


2 


10 


I 


2-1 1 


8 


13 


25 


• 5 


25 


• 1 




2 


3 





I 3 

^ 3 
i 2 
' 2 
.1 

' 1 
3 
1 



20 

15 
15 
10 
10 





- - t 










' 1 


5' 


2 


6 1 


3 


6 


' 2 


10! 


2 




4 


8 




10 1 


4 


13 1 


6 


<12 


yi 


I'i 1 


2 




4 


8 


1 - 


lyi 


0 


13] 


10 


19 


:) 




4 


7 


13 


i 2 


'"1 




23 I 


9 


17 


i 1 




2 




3 


6 


I ' 




2 


0 1 

J 


3 


it 



•No Ci«-<?or\ ^1H included 00 « K)^* t(uestiornairo Ioj .^omo High School, Ornduate Woik or Advanced Degree. 



Appendix H ^ 
{CE)2 STAFF QUESTIONNAmE 



This brief quostionnairu is iiiU^ndud to obtain the opinions of each of the (CE)2 staff about 
Uic goals, procedures, and uutcomrs of (CK)2. The second item in this questionnaire has 
.been administered in identical form to all stuilents, parents and employer instructors. 
Information from^ this questioimaire will be sunimarized and included in the March Interim 
Evaluation Eepon* It will also be shared v/ith the documentation .staff. Since all of you 
are twice as bi^sy as the students, wo are giving you a questionnaire only half the length 
as the student ^)ne. Thanks for your time and responses. 



1- Listed below are lUt^ learning strategies used in <CE) s) . Plei.se rate each in terms 
of how, important >ou feel it is for (CE ) 2 students and seco nd ly in terms of how 
eff^ctiiVely you\fe( 1 it has been implemented this year. If you have comments you 
would like to add about any of these strategies, please identiiV the specific strategy 
and ^'vite your comments on the back of this sheet. 

/ -. 



/ 



Learn/ng Strategies: 



I How Important 
. for (CE)2 Students? 



Not 

Important 
1 2 



Highly 
impor- 
tant 
3 4 5 



a. 


Student Orientation 


1 


■ 3 


,4 


b. 


Student Accountability System, 


1 




J 


c. 


Student Negotiation » . 




.3 




d. 


Pi'oject 


1 

1 


1 • 


7 

1 


e. 


Journals 


, -2 4 


1 


1 

1 1 


f. 


Competencies 




3 


4 


g. 


Exploration Package- 




•4 


3 


h. 


[.eai-ning Level Proc. ss 






-7 , , 


i. 


Learning Level Packa'.'j 


£ 


3 


4 ■ ' 


j- 


Tutors ' 


2 1 


1. 


4 


k. 


Kmployr-v of min-ir- 




2 




1. 


(5roup / r^i^'Hi-s 




3 


2 


m. 


Others (plea?ic list) 


a 



How Effectively Has 


It Been Implemented? 


Not 




Highly 


i!iliec~ 




Effec- 


tive 




tive - 


1 .2 


3 


4 5' 


i 


5 


2 1 


i , 


4 


1 


^ 2 

\ 


1 


1 3 


t 
} 
1 


3 


5 


1 

4 


1 


3 




3 


4 




4 


2 




4 


1 


I 3 


4 




5 


I 


2 


2 2 


1 


3 

1 


2 1 


1 







ERIC 
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2* Quoslion 2 hns alroady bocMi summarized in Tabic 33, p. 92 of this report . 

:K W!>:u inelor.^ if nnv, have vou soon this year that are contribulin^ic in a 
nuiior way to the success of tho (CE) o program? For example, the 
cooperation of most employers, appeal of certain tutors, etc. 

--Staff is more nA'arc of, and comfortable with, program expectations (2)^ 
—Commitment of employers, board of directors, progressive staff 

and good program concepts (2) — 
— Efforts ajid -concern of the staff (2) , 

, 4. What oba'tach^s, if any, have vou seen this year that are limiting the 
success of the (CE) 2 program ? 

—Lack of unity on the part of the staff (4) 
—Lack of direction and inconsistencies in program (2) 
--Conflict of dcjyelopmental and operational staff (1) 
- r^-Instability of tlie .program (L) . ^ 

—Students have difficult}' functioning when they must be so if- motivated (1) 
— Too mahy meetings (I) 

5, Wliat changes, if any, in (CE) 9. staffing patterns wQuld you suggest for 
next year ? 

. —More responsibility, independence and decision-making power to the 

operations staff (2) 
—Replacements in some positions (1) 
—Less students per learning manager (1) 
—None (1) 

* f> 

6, Wliat staff or student forms now being used in the (CE) 2 program do 

vou feel could be eliminated without decreasing the efficiency of operations ? 

—None, at least I can't think of any (3} / 

— Journals (2) \ 

--Time accounting (2) 

— Muc^ (*\rdUcition data (1) 

—Student learning manager conference form (1) 

7, ujint RLurk jit n ssessmenl or evaluation information have you found useful 
this year? How have you used the information ? 

-na^ic skills assessment (CTBS) (5) 
—''Student staffing" information (2) 
— Solf-pirected St^arch and the computer (1) ^ 

— ILueii't seen Tnuch-formative information is usually late and irrelevant (I) 



^Numbers flvvpart^^i.^e^^ s ( ) indicate the frequency of a response. 

II-2 



ERIC 



What addiUonal types of assessment pr evaluation informa tion would you 
like to receive? How freguentlv ? 

"Thorough assossniont of Lh(* life skills area before the start of the 

^ school year (2) , » 

-.^More specific information on student status at job sites (1) 
—Some measure of individual student growth (1) 

In what areas do you feel the (CE) 2 students have made the greatest 
growth so far this year? Why ? 

—Social -skills (5) 

--Personal growth and understanding (2) 
—Learning to be responsible for their actions (1) 

In what areas do you feel the (CE) ? stud.ents have made the least growth 
so far this veui«g Why? 

—Systematic study of career opportunities and work ^trends (2) 
— Management of personal tasks (1) 

—Accountability and willingness to make a commitment (1) 
—Commitment of "communitj^*' experiences (1) 

What additional changes, not already covered in th is questionnaire, would 
you like to see made in (CE) r>? 

—More selective student recruitment (3) 

—Redefinition of personal and professional characteristics needed for 

each staff position (2) 
—More stable planning (I) 



11-3 
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TABULATION OF FEBRUAliY (CE)^. STUDENT INTERVIEWS 



1^ a. Do you feel that the protect staff are concerned about you as 
' an individual ? 



d. 



' Yes (14) 
Comnients: 



No (0) 



They are concerned about her problems (2) 
They show an interest in every student (1) 

Do they know more about you than teachers did at THS ? 

. Vcs (U) No (0) 

In what- ways are the (CE)^ staff helpiiig vou the most ? 



They help. him/her to solve personal problems (G) 

They are available and willing to explain work activities (5) 

Pushing him/her to complete work (3) - * ^ 

Giving individual attention vJhon needed (2) 

Being a friend (2) 

Planning for the future (1) 

Identifying skills he/she has and heeds (1) 

Money management (I) 

In completing competencies (1) 

They have gotten her interested in learning (1) 

Are there, other things that you feel they could do to help you 
more ? ' 



Yes (0) 



Commei>ts: 



No (14) 



It would ho helpful if they weren't so involved in non-studenf 

things (2) 
They are. always willing to help (1) 
Hire an additional LM (1) , , 



ERIC 



The number in parentheses ( j imIi(*nto the- frequency pf a response or 
comment* 



\ 

a* Do you feol that you have acquired any knowledge or skills in '* 
(CE)9 so far that would be directly helpful for gaining or holding 
. la future joT) ? 

Yes (13) No (1) 

b. If yes, what ? 

Welding (2) 

Ability to talk openly with people 
Driving a fork lift (1) 

Working with (teaching) small children (1) / . 

Ability to frame pictures (1) 

Photo development (1) 

The competencies (1) * 

Typing (1) 

Carpet laying (1) 

General knowledge of T cycle engines (1) , 

Already received a job offer from an employer at an exploration 

level site (1) 
Filing (1) , - * ^ 

Operating a cash register (1) - ^ 

Manual dexterity with small objects (1) 
Ability to use assembly room equipment (1) ) ' - 
Automobile painting (1) 
Auto body repair (i) 
Keypunching (L) 
Greater self confidence (1) 
Operatihg^ a telephone switchboard (1) 

a. Do you feel you are asked to fill out too many forms and reports 
in (CE)2 ? 

Yos (o) No (7) Sometimes (2) 

b» A^re there any forms you complete that you think should be eliminated 
or combined with others ? 

Yes (10) No (4) 

Comments: * 

♦ 

Some questionnaires about students' feelings get boring to complete (3) 
The journals should be eliminated (3) 

Reduce the weekly journal requirements from three pages to one 
and a half pages (L) 
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Conimonts ; (continued) 5 

The journal was. helpful at the beginning of the year in helping to 
plan his clay but isixU necessary now since he covers--the 
same information in* greater depth by talking with the LM (1) 

Student Opinion Scale (1) 

Semantic differential-rdon^t understand why it's important (1) 

Project requirements take too long (1) t 

All those from the Laboratory (1) 

a. Are the procedures used by the staff to get students to complete 
program requirements (such as journals or projects) working okay ? 

Yes (14) No (0) 

b. If no, how could they be improved ? 

a. Do you feel you a\^ a bh* to locate the resource materials necessary 
for working on your projects ? 

' i 
Yes (13) No (1) ^ . 

Comments : 

He receives help only from the LM (1) 

b. Where do you usually get the materials ? ^ 

Tigard High School Library (8) 
Multnomah County Library (7) 

From (CE)2 files or Learning Resource Specialist (4) 
Portland State University Library (4) 

Tigard Public Library (3) < " 

Directly from employers (2) 
From the Learning Manager (2) 
Bought own books (1) • 
/ Lewis and Clark College (1) 
Writes to sources (I) 

c» Have you also gotten information for your projects by talking 
directly with employers or people in the community ? 

Yes (8) ' » No (6). 
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Comments: 



She could get sueh information if she wanted to (2) 

Employers seem happy to talk or give materials if you tell them 

why you want them (1,) • . 

Photography project was done completely at a job site (1) 
Hasn*t gotten project information from employers yet but will 

soon (1) 



How much involvement do you feel you.have in selecting your 
own learning goals while developing projects ? 



Comments : 

Plans'' them himself (1) 

She selects topics from, a LM's list of projects (1) 
Sometimes he suggests topic^., other times the LM suggests 
topics (1) 



How do you go about negotiating a project with the learning 
^ manager ? 

"AU students were able to successfully describe how they identified 
' or selected topics, met witl) the learning manager to add or delete 

• specific objectives, and had some choice iii negotiating the scope 
•and focus of the project. " 

' She pushes the LM to write up projects for her {!) 



Do you have enough freedom in selecting how you're going to go 
about workij^ on the project ? 



How well do you feel you are doing in basic skills such as 
read^^, spelling and mathematics ? 

Okay (8) \ 

Pretty gooql except in niathematics (3) 

Not too good in reading or spelling (1) ^ 

Haven't received any progress report in this area but haven't 

asked for it (1) 
Pretty good (1) ' 
Same level as in high school (1) j 



' Much (11) 



'\ Some (3) 



None (0) 




b. Wliat help have you received in these areas ? 
Math tutor (7) 

None but hasnM. asked for any help/Don't need any help (3) 

Got help in spelling from some books given by Student Coordinator 

and by talking with her (1) 
None yet but wilt start on a projeet, including basie skills soon (1) 
The LM gave her a spelling book and incorporated spelling into 

a project (1) 

Writing in journals encourages him to write more (1) 
Projects have helped her read more (1) 
Programmed/ text in record keeping (1) 

c. How much progress do you feel you are making ? 

Math has improved quite a bit (4) 
A little (3) 
Reading^ more (2) 

His reading comprehension is improving (1) 
Vocabulary has improved (1) 
Doing much better now in spelling (1) 
Staying at an acceptable level (1) 

d. Are there other things you might do in basic skills i n (CE)p. to 
help yourself ? 

No (3) 

Could do more reading for projects (2) 
Could work \vith a niath tutor but he doesn^t have time (1) 
No, but the staff are willing to let her try anything ^ (1) 
Tutors are available but she hasn't worked with any yet (1) 
Study spelling (1) 

Needs help in spelling but hasn't asked for it yet (1) 

The LM is encouraging him to start work with a reading tutor (1) 

Planning to work with a tutor for reading and spelling (1) 

e. Have employers helped you identify any basic skills that you 
need to wo A on ? 

Yes (3) No (11) 

- Comments : 

Math (I) 
Spelling (1) 

Vocabulary recognition .(1) 
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f. Have they helped you with any basic skills ? 



Yes (3) No (11) 

Comments : 

Got help in geometry in regard to welding circuit boards (1) 
Employer helped her witli mathematics related to pricing and taking 

customer orders. The employer explained the procedure,,,, gave 

her math problems and corrected her work, (1) 

Here is a sheet showing the various learning processes in Let's 
cross off any that you have not yet used. Please take- a minute to rate 
each process as High, Medium or Low in terms of how useful you think 
it is in helping you to learn. As you go through the list feel free to 
comment out loud on any ones you care to , 

HOW USEFUL FOR 

YOUR LEARNING NOT USED 



LEARNING PROCESSES 




H 


M 


L - 




a. 


Exploration packa{ 


f 


(2) 


(8) 


(4) 




b. 


Learning package 


I 


(7) 


(3) 


(^) 


(1) 


c. 


Employer/community tutors 


(9) 


(3) 


(1) ' 


(1) 


d. 


Employer seminars 


(3) 


(7) 


(4) 




e. 


Counseling groups 




(6) 


(2) 


(0) 


(6) 


f. 


Negotiating (planning) projects 


(8) 


(5) 


(1) 




g- 


Working on projects 


(11) 


(3) 


(0) 




h. 


Student journal 


♦ 


(2) 


(&) 


(6) 




i. 


Using the computer 


(0) 


(8) 


(2) 


(4) 

\ 


j- 


Competencies 




(6) 


(8) 


(0) 

/ 

(0) 


k. 


Actual work on an employer site 


(14) 


(0) 




1. 


Student retreat 




(8) 


(4) 


(0) 


(2) 


m. 


Testing and assessnient 


(2) 


(10) 


(2)' 




n. 


Student orientation 




(3) 


(9) 


(1) 


(1) 



Overall do you fool that (CE)?. is a good program for you ? 



Yes ■ (14) No (0) 

Why ? 

A chance Lo explore jobs (3) 

She enjoys the friendly aLinosphere (2) ^ ^ 

Can plan what he wants to learn ^and do it at his own rate (1) j 
Job explorations are important bjut the program doesnU provide 

enough discipline for getting tasks done (1) 
If\at THS, she wouldn't have learned about art work or practical 

I things like maintaining a checking account (1) 
In/HS he wouldn't have known what work he would want to do 
// after graduating but through (CE)2 he has decided on a 
// career . (1) ^ ' 

lit helped her clecide on some important things in life (1) 

He had academic problems in high' school and skipped school a 

lot whereas he is learnirig/useful things in^(CE)2 and 

attending almost every day (1) 
He 4s learning more tlian he would have at high scIi6ol and wanted 

to get out of high school because it was too easy (1) 
(CE)2 has helped her learn practical things like filing, talking 

with people and operating a cash register (1) 
Likes to work on projects (1) 
Has helped her be more open to others (1) 



Appendix J 

TABULATION OF (CE)2 GRADUATE INTERVIEWS AND QUESTIONNAIRES 

1. What wore the things you founci most rewarding about (CE) 9 ? 

—Exposure to different jobs (4) 
—Personal development (3)' 
—Style of teaching (2) 
—Student-staff relationship (1) 

2. What was the most helpful aspect of th^ (CE) ;) program for you ? 

— Work experience -site visit (3)" » 
—Staff and counseling ^ (3) 
— Personal developmeifit (2) 
— Specific skills (1) 

3. po^ you feel that you "missed out" on anything by leaving the regular 
school program ? 

^ -^Yes (4) ^ ^ ' 

—No (1) 

What ? 

—Contemporary problems class (2) 
— Loss of math skills (2)^ p 
—Loss of association with high school fridnds ^ (2) 
—Typing class (1) 

4. If you could chango one thine about your (CE) o experience, what would 
it be ? 

—Stay in longer (3) 
—I would have worked harder (1) 
— I would have visited more jobs (1) 
—I would 'have gotten placed at a different job (1) 

5. Has, your (CE) 9 experience helped, hurt or hot affected your skills in 
reading, math or commimication ? 

' Helped , Hurt Not Affected 

Beading (ly (0) (4) 

Math' (0) ^ (1) (4) 

Communication (5) (0) (0) 



Numbers in parentheses ( ) indicate frequency of responses* 



In what way has your .(CE)^ experience influenced your work habits? 



—Communicate better (3) 
—Can explore jol) better (2) 
—Budget lime better (1) 
—Learned to dig- right in (1) 
—No benefit of program (1) 

Has your (CE) 9 expcrienee helped, hiirt or not affected your ability to 
ge t to know and communicated with people ? 

—Helped (5) 

Why ? 

—Site visits (3) ' , • " ' 

—Staff (1) * 
—Student interaction (1) 

Since leaving {CE) p have you had a checking account, or filed an income 
tax form, or done things, similar to this .? 

—Yes (5) * • ^ . • 

Has your (CE)9 experience helped, hurt or not affected your ability .to 
do these things ? 

—Helped (4) 

—Not affected (1) * . ' * 

If you had a friend in high school in the same position as you were in 
before joining (CE )g , would vou recommend to him to join (CE) o? 

—Yes (5) 

Why ? 

—I enjoyed (CE)2 (2) 
— 1 was tired of high schooL, (1) 
—For work training (1) 
—If self motivated (1) / J 
— If academically weak (1) 
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What are you now doing? (work, school, etc.) 

—Work only, (2) 
--School only (1) 
—Work and school (2) 



11. How do you feel about what you are now doing ? 

i| --Positive (3)' 
—Negative (1) 
—Not applicable (1) 

* Do you have any plans to change what you are now doing ? 

—Yes (2) ' ^ 

—No (2) ' ' ' / 

To what ? 

— DonU know (1) 

—To another position in present employment^ (1) 

12. Have you decided on a career ? 

—Yes (4) „ 
—No (i) 

Do you fee] it matches your own personal i nterests and abilities ?^ 
i 1 — 

—Yes (4) " ' , , * 

Have you been able to get into (or train for) this line of work ? 

t 

—Yes (3) 

—Not applicable (housewife) (1) 

13. What opportunities^ exist for advancement from yuur present position ? 



/ 



—Not appli^^ble^ (3) - ^ . - 

--Another job within<^esent work (1) 
—None (1) 

14. What do you thinl\ are your chances of being able to advance from your 
pres ent position? Are you satisfied .with this ? 

— Not applicable (4) 
—Good (1) . 
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GRADUATE FOLLOWUP QUESTIONNAIRE 



Although you have left (CE)2 for (we hope) bigger and better things,-* we nave a 
continuing interest in your plans, activities and career progress. We hope you^ 
will take a few«minutes to complete and return this survey of what and how you 
are doing since leaving. Our purpose is to take advantage of your experiences 
both while in (CE)2 and since to help us make this progfam a better one. ' 
What you say will never be identified as coming from you. All infoi-mation 
received will be treated confidentially at all times. Thank you for your 
cooperation. 
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NAME 



DATE 



PERMANENT ADDRESS 



PRESENT (TEMPdRARY) 
ADDRESS 



(strpet) 


(cxiy) 


(stace) 


(zipcoae) 


(Street) 






(ciiy) 


(State) 


(zipcode) 



What have you been doing since you left (CE)2? More education? Work? 
Whatever? In the space below, and continuing on* page iwo, are items for 
you io chdck as they describe your activities. 



A. Educatioh 

[g] Community or Junior College 
D Four year college or university 
^Vocational or technical school 



Semesters 

^1 sem |i]2 sem Qmore than 2 sem 

[J^l sem sem'' Qmore than 2 sem 

□1 sem ^2 sem Qmore than 2 sem 



Field of study, major or type of special training 

— Home Economics' --Gymnastics 

— Communications —Broadcasting 

—General Education —Forestry Technology 

[2] Other (describe) 

—Electronics School in USAF 
—Got Married 
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B, Employment Amount 

* 

(£]Full-time work Ql-^ weeks ; mos (TJmore than 4 mos 

--Head Cook —Switchboard Opr; Teletype —General Help-Auto Dealer 

—Air Force —Secretary /Receptionist 

djPart-time work [|]l-4 weeks [l]l-4 mos Qmore than 4 mos 

~PCC/Student.Help * —Cleaners 
—Babysitting & Material Shop —Inventory /Maintenance 

—Musician , / 

QNo paid* work 

2. To what extent are you now providing your own financial support? 

0 Completely |J] Partially (TjNot any 

3. To what extent are you providing financial support to someone else? 

□Completely (TJPartially . [UNot any 

'4. Have you done any volunteer work for your commimity or for a social or 

political organization since leaving (CE)2'? , 

HjNo [IjYes ' . . 

♦ <- ' * ■ 

If yes, describe^ * ^ ^ ' 

—Geneology work/Gleaning Parks & Recreation Areas/Caroling n 

-.-Church VA)rk/Neighbors ' , - 

5. The statements below name phases of career development. Please circle 
the appropriate number to show how satisfied you are with your present 
progress in each phase. 
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Phase 


Very 

Dissatisfied 






Very 
Satisfied 


a) 


Knowing what jobs you are good at and 
what you like to do 


1 

{-) 


2 

(-) 


3 

(1) 


4 

(3) 


5 

(3) 


b) 


' Knowing where job opportunities may be 
found during the next ten years 


1 

(1) 


2 

(-) 


. 3 

(3) 


4 

(2) 


5 

(1) . 


c) 


Knowing how to locate and apply for a job 


1 

(1) 


2 

(-) 


3 

(-) 


4 


5 

(5) 


d) 


Making a choice of which specific career 
to prepare for 


1 

(-) 


2 

(1) 


3 

(3) 


4 

(2) 


5 

(1) 


e) 


Preparing for specific career 


1 

(1) 


2 

(-) 


3 

(3) 


4 

(1) 


5 

(2) ' 


t) . 


Preparing for an alternative or second 
possible career If the first one doesn't 
work out', ot« you want to change later 


1 

(-) 


2 

(1) 


3 

(1) 


4 

(2) > 


.. (3) ■ 
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6. Below are listed various areas of possible importance for young people to learn, 

CPlease rate each in terms of how important you feel it is to learn these thihgs, and 
hol^lgll {CE)2 helped you accomplish each. 



Students learn to: 

Perform specific occupational skills 



a* 



b. Be punctual and organize their, time 



c. Assume responsibility for themselves 



d. Make decisions and follow through 



*e« Comniunicate with^ others in a 
mature way 



3e ' aware of more career 
opportunities 



g. Work with others 



Evalute their own work 



1. Perform Basic academic skills 



> 

Think through and solve problems 



k. Have a realistic attitude toward self 



1. '*Haye a positive attitude toward work 



m. Have a positive attitude toward 
learning 



n. Prepare for further education 



Improve interpersonal and social skills 



p. Other (please specify) 

"Choose and participate in recreational cjxtracurrlcular actlvltie^ 
—Being able to be open towarcl others 

— Counseling . — — . . , 

*I believe '^Highly Effective" Is related to how much the individual student is ready, 

ERIC willing to contribute to his life—This is not the fault of the program. 

™™"**Very good 



How Important Do 
You Feel This . 
Learning Is? 



Not 

Impor- 
tant 
1 2 



Highly 
Impor- 
tant 
4 5 



How Effective Do You 
Feel the Project Has 
Been in Accomplishing 
This Learning? 


Not 
Effec- 
tive 
1 2 


3 


4 

4 


Highly 
Effec- 
live 
5 


- 1 


2 


2 


2. 


- 1 


3 


^ 2 


1 


1 . 


1 


2 


3** 


- 2 




4 


1 


- 1 


1 


1 


4 


1 - 


- 


2 


4 ' 


- 


- 


4 


3 


- 1 


1 


3 


1 


1 1 


2 


3 




1 - 




5 


1 




1 


3 


"3 


- 2 


2 


2 


1 


1 - 




6 




1 2 




3 


1 


1 - 


2 


2 


2 



J 
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?• The statements below are descriptive of various ways in which (CE)2 may 

or may not have assisted you. Please circle the appropriate number to show 
how much effect it had on you. 



(CE)2 helps prepare students for work 
(C£)2 helps prepare students for college 



Strongly * * Strongly 

Afire e , Agree Disagree Disagree 

1 5 1 

1 3-2 1 



(CE)2 helps prepare students to understand 4 3 
themselves better 

(CE)2 helped me decide what I wanted to 2 2 

do after high schqol 

(CE)2 helped me to deal more effectively 3 4 

'with others 



(CE)2 helped me to decide what I wanted 
to do to make a living 



4 . 



3 
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Appendix K 



TABULATION OF 



STUDENT END OF YEAR QUESTIONNAIRE* 

This brief questionnaire repeats some of the items that you were asked in 
September and adds some new ones that cover your career plans, personal 
experiences and knowledge about the world of work. If you have any 
questions while you are completing the survey just ask for assistance. 

(CE) g THS OSC CWE 

1. What do you expect to be doing one year after completing high school? 

1. I I Working full-time 

^ 46/17 19 47 

2. I I Entering an apprenticeship or on-the-job training program 
^ — ^8 0 10 33 

3. ^1 ] Going into regular military service or to a service academy 

^ — ^ 12 6 0 7 

4'. \ I Attending a vocational, technical, trade or business school 
* — ^8 6 13 . 0 

5. I i Attending a junior or community college 

31 ' 28 45 33 ' ' 

6. I I Attending a four-year college or university 

^ — '12 22 f9 0 

7. I I Working part-time 

23 22 23 13 _ _ _ ^ 

8. P I Other (travel, talce a br.eak) 

35 17 " , 0 27 

9. I I I have no idea what I'll be doing 
^12 11 3 7 

2, How far do you plan to pursue your formal education? 

1. I I Don't plan to finish high school 

^ 0 0 0 0 

2. I I High school graduate ' • ^ ' 
^ 38 11 6 27 

3. High school plus one pr two years of college, community college 
or special training 

y 27 39 45 53 

4. |~j High school plus three or more years of college, community 

college or special training 

19 17 16 20 

5. I 1 Four year college graduate 

' — ^ ^ 8 22 23 0 

(5. I I Graduate or professional training beyond college 
— ^8 11 10 0 

*This questionnaire was administered in May 1974 to 26 students in {CE)2, 18 students 
from the Tigard High School random sample (THS), 31 students' from the Occupational 
Skills Center (OSC) and 16 students in the Diversified Occupational Cluster of the 
O „ Cooperative Work Experience (CWE) Program at Tigard High School. All figures ^ 
EJ^^ shown are percentages within each group. K-1 V" 



• (CE)o- 


THS 


osc 

-• 


CWE 




3. Do you enjoy reading? 










' — ' 12 


0 


0 

0 






2. j 1 Yes, sometimes 
^ 54 


28 


55 


53 




3. 1 1 Yes, I usually enjoy reading 

35 67 


42 


27 




4, This year, a^Jroximately how many pamphlets, 
magazine articles did you read? 


brochures. 


manuals or 




1. rn None 

' 0 

2. n 1 to 5 

^ 4 

3. n 6 to 10 

19 


k 

0 
11 

6 


0 

10 


0 
on 
7 


/ 


4. □ 11 to 20 


17 


29 


An 




5. □'21 to 30 , 


11 


10 


7 




6 r~l More than 30 
1 — 1 42 


50 


42 . 


27 





This year, approximately how many books (not counting textbooks) did 
you read ? 
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None 

4 


0 


3 


7 


2 -. □ 


1 or 2 

31 


11 


3 


7 


3. □ 


3 to 5 

31 


11 


32 


33 


4- □ 


Between 6 and 10 
19 


33 


35 


27 


5. □ 


Between 11 and 20 
4 


22 


23 


13 


6,0 


More than 20 

8 


17 


3 


13 


Do you 


read the newspaper? 








1- □ 


No, or almost never 
27 


0 


3 


7 




Yes, at least once or 
38 


twice a week 
44 


39 


53 


3. □ 


Yes, most every day 
35 


.50 


58 


40 
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If you read the newspaper at least once a week, what sections do you 
usually read? (Check one or more) 



1 , 

i# 


1 — 1 

LJ 


Sports 






33 




31 


44 


68 


2. 


n 

1 1 


'Fashions 










12 


22 


3 


33 


3. 


n 


Front oaire news 










81 • 


89 


90 


73 


4. 


□ 


Comics, 










85 


83 


68 


80 




□ 


23 


22 


35 


13 


6. 


□ 


News columnists. 


such as 








Art Buchwald 










□ 


4 


17 


" 13 


20 


7. 


Other, please list 










35 


11 


19 


47 



Please list two jobs that' you'feel you might like to hold after completing 

your education. Be as specific as possible. For example, say " a draftsman" 

rather than "working at Tektronix.". 



I. , 2. 



Have you given much thought as to why your first two job choices are 
right for you? 

1. []] A little 

12 6 6 7 

2. 12] Some 

,27 ii 35 27 

•3. r~l A lot 

' — ' 50 78 55 67 

How sure are you of steps to prepare for and enter each of the two 

jobs ? 



0 

2. [j]] Have some idea 

23 

3. I I Steps pretty clear 
' — 50 

■I. I I Slcp.s (|Uitc clear 
23 



6 


0 


0 


44 


23 


47 


39 


48 


20 


11 


26 


33 
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(CE) 9 THS " OWE 

11. Do you fct i you will Im* able lo I'omplcto tho iiocossary sicps for a( 
loast one of the jobs? 

1. n Yes 

' 96 94 . 90 87 ' 

2. □ Nut. suiv 

^ 0 6 6 13 

3. I I No Response 

^ 4 0.4 0 

12. Which one of the following is the best way to begin career planning? 

1. PI Look aX what is available on the job market 

15 11 - . 3 27 

2. Q[] Take tests to find out what you should do 

0 0 10 0 

3. Consider what it is you want oiit of a job 

65 78 74 73 

4. rn Read as many job descriptions as you can find 

8 0 10 ■ 0 

13. What will the labor force probably be like 10 years from now? 

1. I I Most jobs will require 4 or more years of college 

27 28 23 27 

2. rn There will be fewer jobs for unskilled workers , 

62 ^9. 52 47 

3. There will be more jobs for high school dropouts than there 
are now 

0 11 13 13 

4. I I There will be fewer' jobs for technical workers 

0 22 , 3 7 

Listed below are nine statements alaout career planning. For each statement 
check either the Agree or Disagree column. 



Agree Disagree 

14. Most persons remain in the same job throughout their I I r~l 

adalt lives. 35 56 52 60 disagrfee-* 



65 , 44- 48 40 agree 

15. Few women work^ outside of |he home a'ft^| marriage.^^ disagrkJ d 

31 , . U . 6 . „20 ^gree — 

16. Less than one-third of all' job openmgs require a college | | | | 

degree. 38 67 29 20 disagree 

62 33 71 80 agree 

17. Most people have the ability to do well in any job if they Q 
set their minds it. .^q 13- disagree" ' 

88 50 84 87 agree — 

There is only one "right job" for a person in terms of ' | | | | 

his abilities. 92 83 90 . 80 disagree 

I 8 17 10 20 agree 

' The unemployment rate of 20-year-olds in the labor market Q 
is, usually less than the rate for other adults. 

pn|/-- ■ 77. 44 68 67 disagree viiH 

23 56 32 - 33 agree 



18. 



19'. 



/ j[CE)2 THS OSC CWE 

20. The State Employment Service Office provides free Q 



information ah^^i job openiji^s and job ti^aining P^ogrgn^g.^.^^^^ 

81 89 100 100 agree — — 

21. Apprentices are paid while they learn. J 

23 28 19 . ^ 13 disagree" — ' . ' — ' 

22. The English an3 math skills^ of freshmen^ are about f^e^lame 

from one college to another. ^ 

65 78 77 67 disagree 

35 , 22 23 33 agree 

Based upon your school/(CE)2 experiences this school year, please indicate your 
opinion regarding the following questions. CIRCLE ONE NUMBER FOR EACH QUESTION. 



23c How helpful do you feel your SQhooi/(CE)2 experiences this year have been^ 
in helping you to understand more about yourself? \ 

, 4 ' G 0 13 l=of little or no help 

8 22 16 7 2 \ 

12 .22 23 53 3 \ 

31 * '39 32 20 4 

46 11 29 7 5:= very helpful 

24. How helpful have your school/(CE)2 experiences been in helping you to 

think about your future work plans? 

4 11 0 7 l=of little or no help 

4 6 6 13 2 

8 44 ^ 16 40 3 

19 28 • 35 27 4 

65 11 42 13 5=very helpful 

25. How helpful have your school/(CE)2 experiences been in helping you to 
prepare for fixture learning whether in school or on the Job? 

0 11 . 0 20 L-of little or no help 

4 17 10 _ 0 2 

27 44 29 40 3 

27 22 29 33 4 

42 6 32 7 5=very helpful 

26. How much control do you feel you have had in planning and carrying 

out your school/(CE)2 experiences, this year? ♦ 

0 0. 6 l=little control 

15 44 10^ 13 2 

19 11 26 ' 53 ' 3 

* 42 22 42 20 4 

23 22 16 7 5=much control 

27. How much thinking have you done about the school/(CE)2 experiences 
you have had this year? 

0 11 6 7 l=very little thinking 

0 11 13 33 2' 

23 11 35 47 3 

" 54 39 19 7 4 

23 ^ 28 26 7 5=much thinking 

28. How relevant do you feel your school/(CE)2 experiences have been in 

terms of your personal interests and skills? 

0 6 0 20 U iittle or no relevance I 

12 33 6 27 2 

19 28 23 27 3 

31 28 39 20 4 

38 6 32'' 7 5=highly relevant 
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-(CE)p/ THS 



OSC . ^ CWE 



If you could make one change in the school/(CE)2 experiences you have 
had this year to make them more meaningful for you, what change would 
you suRRest? 



31 


11 


23 


27 


■1-seie below 


8 


, 11 


26 


7 


2= see below 


4 


• 39 


13 


27 


35see below 


4 


. 17 


6 


0 


4=see below 


0 


6- 


6 


13 


5=see below 


27 


6 


3 


0 


6= see. below 


8 


0 


. 6 


7 


7=see below 


19 


11 


16 


20 


8=see below 



l=no response/don't know 
2=no change ^ 

3=less requirements/more choice 

4=more practical classes/more job information 

5=change in .curriculum content 

6=change in instructional strategy 

7=change in personnel 

8=other 
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Appendix L 

TABULATION OF NONVOLUNTEER STUDENT QUESTIONNAIRE 

(May 1974) 

Last month you were given information about the Career Education - 
Project called (CE)2- Our records indicate that you were not 
one of the students to apply for the project. Because (CE)2 is 
a new type of program, little is known about why students apply 
or do not apply for such* programs. We hope, therefore, that you 
will take a minute or two to let us know your reasons for deciding 
not to join (CE) o for next year. Your answers will help us to 
gain a better under^standing of how (CE) 2, is viewed by students 
at THS. Please, complete this questionnaire and return it to your 
teacher. 

(N=97) \ 

1, Why did you dedide not to participate in (CE)2 next year? 
Check as 'many reasons as apply. 



1. 
2. 



39 



14 



3, 132 
4. 



12 



5. 39 



6. 
7. 
8. 



13 



44 



50 



I did not want to leave my friends at Tigard High. . 

I was afraid I would be less able to participate in 
extracurricular activ^ities ,at the high school if I 
joined (CE) 2- 

. ^ ! 

I was not really sure what I wodld be required to 
do in the (CE) 2 program. 

It looked like (CE)2 might require a lot more work 
than high school. 

I am concerned that MCE) 2 might not properly prepare 
me for college. 

I am not interested in learning more about careers. 
I prefer^ the type of education given at THSi 
Other reason (please write in why) (SEE ATTACHE>D) 



2. What were your .parents ' reactions to your joining (CE) 2^ 



1. 


8 


2. 


15 


3. - 


46 


4. 


12 



They encouraged me to join. 

They were against my joining (CE)^* 

They neither encouraged nor discouraged me from 
"joining (CE) 2* 



Other: 



(SEE ATTACHED) 
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'ftow would a' career education program like ICE) 2 have to be 
changed to interest you in joining It? 



>-^-(SEE ATTACHED) 



Was the student recruitment information presented to you. about 
(CE) 2 adequate to answer all your que.stions about the program? 



1. 



52 



24 



No 



Yes 2. 
If no, what other" information would have been helpful? 
(SEE ATTACHED) ' ^ ' 



What do you plan to be doing one year after high school? 

1. [isj Working full-time 

2. ^ Entering an apprenticeship or on-the-job training 

program 



3. 

4. 

5. 
6. 
7. 
8. 



\25. 



32 



25 



15 



9. • 8 



Going into regular military service or to a service 
academy 

Attending a vocational, technical, trade or business 
school 

Attending a-^ junior or community college 

Attending a four-year college or university 

Working part-time 

Other (travel, take a break) 

I have no idea what I'll be doing 



Sex 

1. 

2. 



33 



43 



Male 
Female 



Grade Level 
1. 



33 Sophomore 



2, 4£ Junior 
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THANK YOU 



• J- 



ERIC 



1. MVhy did you decide not to participate in (CE)2 next year? 

—likes traditionaLeducatlon better/(CE)2 does not appeal (20)* 
■ . — ^program requirements not congruent with student's learning style and 
abUities .<7) 

—schedule conflicts (e.g., job) (5) * ' 

— parents objected (3) 

—lack of information (3) . - ^ * 

—other ,(8) . A ' . * * 

V / ^ . ' 

2'. What were yoUr parents** reactiona to ^our joining (CE)2? 
—parents did not kno^w^about it (11) * 
—parents thought it jivould be good in senior year (2) 

' * — parents didh't^care (2)' . " ' 

—other {4) / ♦ > 

3. How wduld a career education program like {CJS)2 have to be changed 
*i to interest you in joining it? 

^_it wpjLild never interest the. student. (17) 
^ ^ * --make it ixiore traditional/structure (8) 
—better ^presenlation/more information (7) 
—concerned^ about college^ preparation/Admission (5) • 
, — less separation from high school (2). ' 
• ~other-(13) ... • - . - v . . / ^ 

*4« Was .the student recruitment information presented to you about (CE)2 
adequate to ans>yer all your questions about the program? What other 
information would have been'- helpful? 

— more information on what is required of students (5) / 
\ "Stih ^on»t understand the prograni (3) 
, -tj^wliat careers are offered (2) 
— lyiore contact with, (CE)2 participants 
-^o'ther (5) . ? . , 

•J ,, - . ' .. •• 



A 



■J 

\ 

*Nuinber in paYen'tHeses indicates number of students giving Hiat response. 
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Appendix M ^ , ^ v. 

LIST OF SKILLS AND EXPERIENCES GAINED BY (CE)2 STUDENTS 
ON LEARNING LEVEL SITES CLASSIFIED BY OOH CLASSIFICATION* 

Industrial Production and Related Occupations , . ' ^ 

Use power saws and glass cutter 

Learn soldering technique - ^ * 

Learn to manipulate a color-coded wire system diagram 

Bebome familiar with production quota 

Assemble boat trailer 

-Pi^^paurenboats^ delivery.. 

Operate metal working materials 

Office Occupations 

File and sort office materials 

Write purchase orders and requisitions ' % 

Receive shipments 

File . ' . - 

Type ■ ' 

Take shorthand 

# 

Telephone skills 

Operate a ceiitrex system 

Develop techniques for takmg^messages > \ 

Read and write work orders ^ 

Key punch operator 

Office machines 

Switchboard operation 

Handle customer accounts 

File and alphabetize 

Maintain telephone reminder system ^ 

Complete vehicle mileage forms 

Receptionist skills 

Become familiar with billing procedure 

Use adding machine " • ♦ ^ 

Compute cost of using xerox machine 
Rplodex filing 

Compute employee withholding for payroll 

Warehouse supply techniques 

Order and price parts 

Compute operation skills 

Learn IBM symbols and neumonics 

Prepare JCL stream 



* Occupational Outlook Handbook , 1974-75 Edition, US Department of Labor. 



Office Occupations (continued) 



Assist in job breakdown 

Extract and distribute billing information 

Increase typing speed 

Service Occupations 

Toll and information operator 
City maintenance 
PBX 6perator 

RiBcord. formulas used in hair conditioning 
Cut, set, wave, color and style hair 
Manicure nails 

Public speaking for police department 

Research, interpret and write police summaries 

Fire fighting techniques 

Write accident and crime report 

Operate police car lighting and- radio system 

Public speaking to citizens' groups 

Bicycle safety inspection 

Write traffic citations 



Education and Related Occupations 

Teach physical awareness and socialization skills to trainable mentally 

retarded adults 
Work with preschool children 
Write up case study 
Teach basic prereading skills 
Teaching assistant 
Observe student behavior 
Monitor behavior of preschool children 
Assist librarian 

Review books and establish grade placement 

Use Dewey decimal system 

Check out books 

Teach mentally retarded 

Child supervision 

Develop math curii:culum 

Develop lesson plans 

Take roll and tabulate lunch count 

Shelve books 

Maintain book fine and renewals 



Sales Occupations , 

Stock bolts of materials 
File and retrieve patterns 
Assist customers 
Work cash register 
Identify and price synthetic material , 
/Understand operation of retail store 
Weigh and calculate prices for bulk food items 
Complete modeling course ^ 
Set-up boat displays . * 

Public relations work 
Demonstrate sales techniques 



Construction .^Occupations 

Observe and participate in construction of a single unit dwelling 
Use blueprints 
Use power tools 

Stain and paint plywood cabinets 

Observe quality control procedures • ' 

Begin understanding Oregon's electrical codes 1 

Participate in commercial wiring 

Become familiar with tools of commercial electrician 

Gain awareness of power- source and power system 

Use hand tools 

Sanding 

: Occupations in Transportation Activities 
(None) , 



Scientific and Technical Occupations 

Reading and interpreting chemical formulas 
Gathering, sorting and distributing statistical data 
Performing lab tests 
Drafting 



Mechanics and Repairmen 

Observe and participate in maintenance of prop aircrdft 
Electronic testing of equipment 

Become familiar with hand tools for aircraft servicing 
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Mechanics and Repairmen 



Become familiar with requirements for hourly check procedures 

Read work orders 

Install telephone equipment 

Order equipment 

Participate and. observe diesel mechanics _ - ~ - 

Take compression readings 
Repair injector systeni in diesels 
Repair brake system in trucks 
Become familiar with hand tools 

Become familiar with technical vocabulary used in diesel mechanics 

Learn how to procure parts necessary to repair diesels 

Routine niaintenance of city vehicles 

Replace' brake systems 

Cycle assembly 

Rebuild cycles 

Detail cycles 

Cycle mechanics 

Car sanding 

Masking preparation 

Repairing dents 

Priming automobiles 

Painting automobiles 

Welding 

Boat maintenance 

General engine maintenance 

Internal combustion mechanics 

Entry level skills in repairing, media equipment 



Health Occupations 

Dental terminology 
Assist in oral surgery 

Learn about tools used in dental restoration 
Observe x-ray procedures and process film 
Determine dental replacement costs 

Operate blood pressure and other emergency medical equipment 
Operate ambulance equipment 

Use oxygen equipment and other emergency aid equipment 
Social Scientists- 



Case study writing 
Interviewing techniques 
Survey audience 



Social Service Occupations 



Counseling for outdoor school 
Write up case study 
Monitor counseling groups 

Schedule volunteers- - - - - - 

Investigate and use counseling game 
Interview techniques 
Write reports for court 

Art, Design' and Communications-Related Occupations 

*» 

Frame and mat pictures 

Conduct radio survey and analyze statistical informati 

Write public service announcements 

Operate console, and recording equipment 

Develop dark room techniques 

Participate in portrait retouching 

Use lights for photography 

Handle radio communications 

Operate radio station console equipment 

Other 

Become ,aware of community resources 
Experience court litigat-ion involving liability suit 
Read and interpret street map 
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COMPLETE CASE STUDY REPQRT 



Mike--A Case Study 

Background . Sitting in a classroom at Tigard High School (THS) was 
difficult for Mike. In some classes he was way behind. In math he was 
always the first to finish a test. "I loved math and could always finish a 
test" in about ten minutes, but I wasn»t doings well in my other classes, " 
Mike explained. 

■J 

A 17-year old junior, Mike has finished a year at (CE)2 and is looking 
forward to completing high school there. He first heard about (CE)2 at 
THS when he was a sophomore. "I really only went to the assembly to 
get out of one of the classes I didn't like," Mike confessed. 

But after listening to the (CE)2 explanation, Mike was quickly sold on ttie 
idea. He not only liked the notion of learning on the- job, but also thought 
the program might allow him to work at his own speed. 

Mike took some descriptive materials home to his parents and they joined 
him in an evening session at the (CE)2 learning center to find out more 
about the program. Mike then filled out an application form and was 
accepted, into the program for his junior year. 

Early testing sessions. .verified the incpnsistency of Mike's experiences in 
school. While his reading and language scores were well below .the average 
scored by a randomly selected group of juniors at Tigard High, he showed 
above average abilities in study skills and demonstrated superior ability in 
math. 

On a less tangible level, (CE)2 staffers early m the school year described 
Mike as being hyperactive, submissive, lacking in self-confidence, and 
unconcerned about his health and physical appearance when he started the 
(CE)2 program. He was also judged to have severe writing deficiencies. 
Consequently, Mike's (CE)2 learning manager devised a learning plan that 
would build his communications skills (in both writing and interpersonal 
relations) while encouraging him to explore several career possibilities. 
Mike's job experiences and projects were designed to capitalize on his 
existing interests and to broaden them. 

(CEVo Experiences . A typical day for Mike started at 8:00 a. m. ^ just as 
in any other high school, but the hours in between varied a lot. When he 
first arrived at the,>(CE)2 learning center, Mike said he^ usually spent some 
time "fooling around" with the computer before he worked on projects 
underway at the center. 
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On his original application Mike indicated his career preference would be a 
computer operator. This led to an oRoortunity in (CE)2 to further explore 
,that area and to learn more about the job. During, April and May, Mike's 
second learning level experience, took place in the computer department of 
Firstbank Services. He broke up his time there each day into morning 
and afternoon blocks, often arriving before his emplqyer_instructor did for 
the moming^-period; Mike^irsually spenl that time going through computer 
workbooks. When his employer instructor arrived they went over flow 
charts together and worked on computer language. 

Mike returned to Tigard High Scho61 for lunch and a German class he 
selected as a project. (CE)2 students seldom take classes at THS but 
Mike had a special interest in German since his grandparents speiak the 
language. 



Following German class Mike returned to the learning] center for an hour 
of work on other learning activities and then went back to Firstbank. 
*»I often stayed there until 5;00 p.m.," Mike said. 

Mike's activities and interests widened after that first year in (CE)2 but 
his goal of becoming a computer programmer was reinforced by the 
learning level experience at Firstbank. 

The start of a new hobby- -collection of computer materials—also occurred 
during the time he spent at Firstbank. ''My employer instructor gave me 
some books to read that actually started the collection," Mike said. 

Mike's interest in^^ animals also was enhanced by his (CE)2 experience. 
Mike always liked animals and his family owned a: horse since he was 
12 years old. By picking blueberries Mike was able to save enough to 
buy his own colt two years ago. 

One of Mike's favorite projects^^ during the year related to his horse. The 
project was -^designed to help Mike with Basic Skills and to improve his 
critical thinking skills. Mike read about breeds of horses and how to 
train them. Now he has joined a 4-H group with hopes of training his 
horse for show. 

Several months later, Mike again focused on animals for a (CE)2 project. 
This time he used the local zoo as a resource, interviewing the zoo manage 
and doing a thorough study of the Alaskan Brown Bear. Mike also joined 
an Explorer Scouting Club of volunteers to help at the zoo on a regular 
basis. 

"I really liked working with the bears," Mike reflected. "They were really 
playful. Did you know when they rub their hair against the bars it sounds 
like a ^/iolin?" 
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Evaluation of the zoo project, one of the last Mike conypleted during the 
year, showed much improvement. The learning manager commented to 
Mike, 'Tou are getting your projects done faster, and I think you are 
taking more time than you did at first to do a better job." 

Accomplishments . Mike got off to a slow start in the Life Skills area- 
Like some of his peers, he went through a period described by one of the 
learning managers as "freedom shock." When removed from the more 
rigid structure normally experienced in a typical school setting, Mike 
tended* to avoid his responsibility to the more "academic" side of his 
learning program. 

m ^ ' ^ 

At first, Mike seldom followed up on commitments and often did not let 
the staff know what he was doing. By the end of the year, he had 
improved remarkably in both of these behavior areas. 

Through* the weekly writing required in maintaining his journal, Mike 
, demonstrated a significant improvement in written commimications both in 
*- ^ terms of presenting ideas and feelings and in the mechanics of writing. 
Mike also noted an interesting change in his behavior* "I used to watch 
a lot of TV and never did any reading, " Mike said at the beginning of the 
following school year. "I read two books last year and have completed 
eight more this summer. Now I go to the book instead of to the television," 
he added. Mike's favorite reading material is science fiction. 

Mike also^ observed a difference in his attitude about homework. "After 
going to/ school for six hours I wouldn't sit down and do homework* But 
in {CE)2 I wasn't sitting in a classrooni, so I didn't mind going home with 
some more work on my journal or projects." 

Mike^s personal development was also undergoing change. Much of this change 
was attributed to his employer instructor, an elementary school teacher, who told 
him how important it is in the work world to wash and wear clean clothes. Both she 
and the project staff gave Mike much positive reinforcement when his dress 
improved. That same employer also told Mike that she was really interested in 
what he had to say and therefore wanted him to speak slower so he could be understood. 

Mike's attendance improved at (CE)2. During the year he missed only six^ 
days. This was better than thp average absence for others in the program 
which was found to be 12.3 days missed during the year. 

Like a number of other {CE)2 students in his class, Mike went out on 
exploration level experiences' but completed relatively few otlier program 
requirements during the first three months of the school year. By April, 
however, he was simultaneously working on eight different projects and 
pursuing a learning level experience at Firstbank. By the time Mike 
completed his junior year he had finished mne of the required thirteen 
competencies, explored nine business sites, completed two learning levels 
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and carried through on nine projects^ Two were dropped during the year 
and one other is uncompleted but could be finished in the coming year. 
(See accompanying chart for an illustration of Mike»s learning activities.) 
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On a more specific level, Mike's competencies included transacting business 
on a credit basis, maintaining a checking account, designing a 
comprehensive insurance program, filing taxes, budgeting, developing 
physical fitness, learning to cope with emergency situations, studying 
public agencies and operating an automobile • 

y 

Mike did not achieve the same level of success on all of his job sites, 
However, his performance consistently improved throughout the year,// 
Mike criticized the exploration packages when he started them in tji^ first ^ 
months of the program, and although he couldn't pinpoint how,^SJfid they 
^ could be better. His own reliance on the questions provide^^in the package 
was noted by the (CE)2 staff with a comment that he rax^y followed up on 
any cues provided by the person he interviewed. The packets reflected 
Mike's disinterest in the exploration portion of (CE)2fwork, They showed 
little effort and a certain sameness of remarks about his impressions at 
the various sites. X 

Mike explored career possibilities at Dell3all Ford, Moore's Audio Visual, 
Girod's Super Market, Williams Air Controls, Te^npleton Elementary School, 
Tualatin Development Corporation, City of Tigard, Mt, View Junior High ^ 
School and Firstbank Services. 

Mike's first learning, level experience was Templeton Elementary School, 
At the end of three and one-half .months the two teachers serving as his 
employer instructors indicated concern about attendance, punctuality, 
'initiative in learning and amount of supervision needed to see that Mike's 
time was used constructively, Mike did show significant improvement in 
appropriate dress, personal grooming and quality of work on assignments. 

Reports from^'the second leamirig level experience— at the computer 
department at Firstbank Services—show a nfiaTked improvement. The 
employer instructor there rated Mike satisfactory in all aspects 'and by the 
time of the final evaluation gave excellent ratings in ten categories— 
attendance/punctuality, adhering to time schedules, understanding and 
accepting responsibility, observihg employer rules, showing interest and 
enthusiasm, poise and self-confidence, using initiative in seekijig 
opportunities to learn, using employer-site learning resources, beginning 
assigned tasks promptly, and completing tasks assigned. 

During the latter part of the school year, Mike worked on several projects 
at once. He worked on a project on basic electricity and took a course 
on "Beginning Guitar" for project credit. 

To improve his communications skills, Mike also worked on an intergroup 
relations project. This project grew out of an awareness by the staff that 
Mike liked other students but seemed to lack social interaction with his 
peers and the staff, Reports at the begimiing of the year indicated that 
he appeared dependent and submissive and was an immature conversationalist. 
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In response to these observations, Mike's learning manager negotiated project 
objectives and activities with him that would help improve his communications 
skills and help him solve some of his interpersonal problems. At the end 
of the year Mike noted a positive change related to his communications 
skills. '1 can nov/ speak up ia groups, he said. • 

Mike's unfinished project related to ms own~exp'eriences- and' inter He 
moved to the Portland area from Canada ten years ago and frequently ; 
returns to see relatives. The project, on immigration laws and regulations, 
will increase Mike's knowledge in the functional citizenship area. At the 
same time, it will help Mike improve his grammar and spelling. Students 
have the option of completing a project started during their junior year 
when they are a senior; consequently, Mike m^y yet finish the project. 

At the end of the year Mike said, 'It turned out even better than I thought. ^' 
Things he liked best about the new experience at (CE)2 were working at 
his own speed, going to a job and having more freedoni. 

Comparisons . At the end of the year, Mike's tests showed significant 
increases in both reading and language skills. In the matli and study , 
skill areas oiJy slight increases were indicated. 

Tests on attitudes, given both at the beginning and the end of the year, 
indicated positive gains in self-reliance, understanding of roles in society, - 
tolerance for people with differences in background and ideas than his, and 
openness to change. 

Aspirations did not change for Mike. He still wants to gojinto computer 
programming after finishing college. "When I started the year I really 
didn't know too much about computers. I feel now that I know a lot and 
want even more to ihake it my career. " 



Kari"A Case Study . / • 

Background . According to Kari's Tigard High School counselor, she was 
"a personable and able student, never^a trouble-maker." But although she ^ 
was an above average student, Kari was bored with her high school classes. 

Her disenchantment led her to apply at the end of her sophomore year to 
(CE)2 as an. alternative to her regular high school. "I really applied just 
to get out of Tigard High School," Kari confessed. "I was taking clj^sses 
that didn't have anjthing to do with my life later. I didn't think I should 
have to go through all of that and be bored to death, " she added. 
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other reasons Kari cited as most 'important in 'applying to (CE)2 included 
wanting more freedom and independence, having the opportunity to choose 
licM- own IIIV Mtyks and tMiJoylng Iho intriguing lUoa ol' im oxixMiunco -based, 
career education program. Of lesser importance to Kari was actually 
learning about careers and job preparation. _ ■ 

AFfirst Kari's parents were opposed^to the (CE)2 opportunity. Eventually 
they approved. Even when Kari^s friends objected, however, she was 
determined to try the new alternative. 

(CE)9. Experiences-- Junior Year . Kari was not selected to enter the program 
until the second semester of her junior year. Consequently, the number of 
projects and competencies required to be completed by her was adjusted to fit 
her reduced of program participation. Based upon her high school 

counselor recommendations, previous educational experiences at Tigard High 
School, performance on the (CE)2"administered Comprehensive Test of Basic 
Skilis, and personal, interviews mth the (CE)2 studeht coordinator and with the 
learning manager, an individualized learning plan was prepared. Kari's learning 
plan-was designed to i^nable her to continue her academic progress while allowing 
her to work on mjojects peiated to her interests and to real-life situations. 

During therms t half bf her junior year, then, Kari completed six projects 
in the Jtafe Skills area, investigated five specific careers on the exploration 
lever and fulfilled the learning level requirement. 

For example, one of Kari's projects called "The Volunteer Way" investigated 
the ways volunteer organizations function, giving her an awareness of 
volunteer organizations available within, the community. It satisfied the 
functional citizenship area. 

Kari- selected two group activities for her personal/social development 
projects. "Motivation^or Career Success" required the completion of a 
goal ^sa Karl could demonstrate self-direction and responsibility by making 
.her own decisions and initiating action. Kari also decided to do a unit 
called "Up Against the Tube—A TV Unit" simply because people are 
influenced and educated by television. The project provided an opportunity 
to understand, analyze, criticize, evaluate and judge the experience she 
gained from watching television. 

In addition, Kari completed Jive cax^eer explorations during this period. 

She explored Tigard US National Bank, Outside%, Georgia Pacific, ^ 

dentistry and Hotline Access! She was critical of the usual three days 

required to finish an exploration. "I could always tell the first day if it 

was a place I would like to work, " she explained. In one case Kari eveh 

dropped an exploration before it was completed. "I went to a law 



enforcement agency and the second day called back to the center for 
someone to come get me. It was obvious I was wasting my time," she 
said. 

\ 

She was also critical of the exploration packet. These packets, filled out \ 
by students, describe the operations of the sites visited and give the \ 
students an opportunity to -compare personal skills with job requirements. \ 
The packets are filed at the center to provide background for other students 
before they visit a new site. "I think the .e}qploration packets aren't v/orth 
the effort," Kari said. "No one uses' them and it takes a lot of time. If 
someone else got a negative impression and I read the packet, I might not 
go on an exploration when it could be a job I would really like," She added. 

Kari's reaction to her indepth job experience (learning level) was much 
more positive though. From her explorations Kari selected Outside-Ih, a 
drug rehabilitative center, for this experience during her junior year. She 
worked with counseling, one of her selected career possibilities. Outside-In 
gave Kari extensive skills, varying from bookkeeping to interviewing techniques. 
She learned how to file, classify materials, write letters, balance daily and 
monthly financial- reports and also applied communications skills when informing 
patients about services. 

Kari completed four of the (CE)2 program competencies during, her first 
half year in the program. They consisted of the transaction of business 
on a credit basis, maintenance of a checking account in good order, design 
of a comprehensive insurance program and explanation of personal legal 
rights and responsibilities. '■ 

^CE)o E xperience— Senior Year . After her junior year, Kari seriously 
• considered returning to Tigard High School. She had worked during the 
summei at the (CE)2 learning center and had developed some real conflicts 
with a , irticular staff member. This conflict and her mother's encouragement 
to retur. . to the high school made the decision to stay difficult. 

"It would have been less work (at Tigard High School), Kari said. "I 
could have finished there each day by noon. But then I leam6d the fellow 
I wasn't getting along with v/ould be leaving, so I decided to stay with (CE)2. " 

During the first semester of her senior year, the learning ii\anager described 
Kari as relaxed, eager to tx-y new things and wanting to get deeply into the 
program as quickly as possible. She was described as dlemonstrating a 
high level of maturity and self-direction. Early assessment results placed 
Kari above average ijx reading, language and study skills and well above 
average in mathematics skills. 

During fall semester Kari completed seven of the ten required Life Skills 
projects^ Most of her program experiences were group activities or 
projects conducted v/ith at least one other person. For example, she 



participated in a group activity bn "Juvenile Eights and the Law" designed 
to challenge her to read technical inaterial* 

The requirements in tlie personal/social area were met through "Motivatidn for 
Career Success" and "Public Spcaldng and the Organization of Programs-" 
The first project was based on a^ minicourse package that asked Kari to 
develop a plan demonstrating self-direction. The public speaking activity 
helped hex achieve self-confidence and improved her oral communications 
skills. She assisted in making presentations to those interested in the (CE)2 
. program as a part of this project* 

Candle making was a group project in creative development. Kari^s other 
project was "Reading for the Pleasure of It," whic^ had a positive effecP 
on increasing her interest tn reading. Karl's final student questionhaire 
indicated ske had read more books than previously and^alsb was "more - 
interested in reading other kinds of materials (newspapers, magazinesV. 

An "Ad Biz Quiz" done with another student t9 meet -critical thinMng 
requirements involved critically reading and analyzing advertising. The 
two girls studied advertising techniques, visited an advertising agency and 
designed their own ad. Kari also completed a project on "'The Future of 
Communications" at General Telephone while there on a learning level 
experience as an operator. A critical thinking skill highlighted in the 
project was' learning how to logically follow through on instructions. 

Science requirements were met in part through a group study of "Terrariums. " 
Students learned the process of life cycles, located materials and'built a terrarium. 

These pj^ojects interested Kari but by midyear she was again in a slump. 
For a period Staff members noted Karl's disinterest, concern ^vith diet and 
home* problems^ need for encouragement, noncommittal 'attitude, lack of' 
follow through on conamitment to a definite employer site, and her 
unrealistic attitude toward jobs, skills or time schedules. "During those 
three months I really didn't^care, " Kari reported. A number of staff 
conferences were held with her during this period to help her decide what 
she wanted to do. Kari was encouraged by the {CE)2 learning manager to 
explore office occupations. Georgia Pacific was suggested because it 
offered a broad variety of office tasks as well as an opportunity to explore 
laboratory work. 

An exploration at Georgia Pacific in February, followed by a learning level 
experience in March, however, turned Kari's attitude around. Her enthusiasm 
^ sparked again and she finished the year on a positive note. During her 
' learning level at Georgia Pacific Kari used the opportunity to relate the 
employer site to a particular Life Skills area, that of functional citizenship. 
She Rooked- at legal and safety procedures and related their impact to 
Georgia Pacific's operation. She met another science requirement \yith ah 
individual project in the company* s Gypsum Division laboratory. The 
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project^ s twenty -one objectives helped Kari gam an understanding of the 
scientific method by testing gypsum* At the same time she acquired some 
saleable job skills by working closely with a division manager and his 
secretary. The division manager encouraged her to learn shorthand. 
Despite the fact that she had studied shorthaqd in high school and disliked 
it, she became aware that she could use some tapes at the learning center 
on her own and develop the skills of .shorthand for her own improvement 
rather than to meej; a course requirement. Kari i5racticed shorthand and wj 
reinforced for this by the people at Georgia Pacific where she was given 
real life opportunities to take dictation from, the division manager and type 
it into actual business letters. 

Specific job-related skills Kari learned during the (CE)2 experience her 
senior year were telephone sldlls, counseling knowledge, laboratory skills, 
filing, shorthand, typing and specific telephone operations. 

She had explored careers at Tigard School of Beauty, Public Defenders, 
Tektronix, General Telephone, Allstate Insurance and Georgia Pacific, 
'Kari pursued learning level experiences at both General Telephone and 
Georgia Pacific. 

During her senior year Kari completed Jhe rest of her competency 
requirements including filing state and federal income taxes, budgeting, 
responding to emergencies, participating in the electoral system, maldng 
use of public agencies, applying for employment and holding a job and 
•operating and maintaining an automobile. Her projects were completed 
satisfactorily and on time. (See accompanying chart for an illustration 
of Kari's learning activities,) 

Final staff comments indicated that watching Kari make the transition from 
teenager to adulthood was a rewarding experience. J'he learning manager 
said, "Kari is an attractive, polite, intelligent young lady who has learned 
how best to capitalize on her capa.bilities and assets,^' 

One of Kari's employer instructors reported, ''She does neat work. In the 
lab she is cautious and exact. She adapts to new situations and accepts' 
instructions well. She retains and applies instructions with ease and 
displays an inquiring mind." 

Staff menibers indicated that Kari exhibited the same traits in her work 
on projects'at the learning center. They projected a pr^omising future for 
the graduating senior. 

Kari completed all of her (CE)2 requirements by early May and was 
allowed to leave the program at that time although her formal high school 
graduation occurred the following month. After Kari graduated in June, 
she returned to one of her (CE)2 learning sites—this time as an employee. 
She began work at General Telephone as a full-time operator. 
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Appendix O 



DESCRIPTIONS ^OF (CE)2 AND COMPARISON GROUPS 

Contained in this appendix are descriptions of (CE)2, the Cooperative 
Work Experience Program (CWE) at Tigard High School, and the Occupational 
Skills Center (OSC), It is hoped that these descriptions will help the reader 
integrate and interpret the data contained in this report. To this end, the 
goals, curriculum, learning resources, nature of the student body and 
student evaluation procedures of the experimental and comparison groups 
are described. One comparison group, the Tigard High School random 
sample, is hot described in this appendix because the individual students 
within the sample have experienced a heterogeneous set of courses and 
experiences, thus making a common description difficult- It should be 
noted, however, that the THS random sample of students was designed to 
exclude students in the Diversified Occupational Cluster of the Cooperative 
Work Experience Program and those in (CE)2. 

Purpose 

To provide an individualized, comprehensive experience-based educational 
program that will directly facilitate the transition of youth froni secondary 
"schooling" to work and/or higher education. This is to be accomplished 
through more specific student objectives which include the following:' that 
students will progress in the Basic Skills at a rate comparable to that of 
students^enrolled in the regular high school; that the students will develop 
Life Skills (including critical thinking, citizenship, personal and social 
development, creative development, sciences and a series of "survival 
competencies"); and that students will develop career awareness (including 
increased knowledge of self, knowledge about the world of work, job skills 
and knowledge of the job market). 

> Curriculum 

Content . Includes work in the Basic Skills, Life Skills and Career 
Development. 

Learning Strategies . Student projects, which are individually planned and 
negotiated by a learning manager 'and the student, are the central learning 
X activity of (CE)2. Students also keep a daily journal describing their 
e3q)eriences and work on a series of "survival" competencies. Individual 
work 'With tutors is also available. 
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EnvirQnment. The learning environment is community based (i. e. , outside the 
traditional high school): All learning activities take place at community or 
employer sites, or in a learning center on an individualized basis. 

Learning Resources . " ' 

Learnitig resources include employer and community instructors, all employers 
and public fecilities in the community (library, city hall, banks, hospitals, 
etc.), (CE)2 operations. staff (operations director, two learning managers, 
two employer relations specialists, one counselor, one learning resource- 
specialist), computer terminal' and '(CE)2 library. 

Student Size and Selection Ero'cedure 

There were approximately 50 students in (CE)2 during the 1973-74 school 
year. Recruitment for the program was directed in the spring of 1973 at all 
current Tigard High School sophomores and juniors. Students applying for 
the program for the fall<- of 1973 who were not able to be accommodated 
because of the program limit of 50 students were given an opportunity to join 
the program later in the year as vacancies occurred in (CE)2. 

Evaluation of Student Progress S 

The progress of (CE)2 students is evaluated by a variety of people. The " 
employer instructors ^valuate the students on their performance at employer 
xsites, community resource people evaluate perf or mance^in special classes 
abd projects and certify the successful completion of the competencies, the 
leSming managers evaluate student performance on the ten prescribed Life 
Skiirs, projects and the entire (CE)2* staff evaluate the academic and nonacademic 
progress of the students in weekly student staffing* sessions. Evaluation 
reports to parents and to colleges, in the case of graduating seniors applying . 
for admission, are largely, descriptive in nature. 



Occupational Skills Center 



Purpose 

The purpose and goal of the Skills Center is to provide students with the 
opportunity to develop specific skills which they may use to enhance their 
chances of success in further formal education, in immediate work or in 
various apprenticeship programs. This general goal is accompanied by 
specific career cluster goals which include vocational skills, career entry 
skills and personal development. Approximately 42 ptercent of the 1973 



* See page 59 of this, report for a more complete description of the 
student staffing process. 
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graduates continue^ their education beyond high school, 31 percent worked at 
a job related 'to their career cluster,' 20 percent worked at a job not related 
to their career cluster and 7 percent were unemployed. 

Cur-r-iculuin 

Content . The content of the curriculum at the Skills Center includes work 
in one or more of ten career clusters: agriculture, building construction, . 
chUd services, marketing and distributive education, data processing, 
electricity and electronics, . graphic reproduction, health, occupation, industrial 
mechanics and metal working. 

JLearning Strategies and Environment . Students spend one half of the day in 
traditional high school classrooms at their home high school and the other- 
half at the Skills Center where they attend cluster classes, seminars on job 
search techniques and resume writing, and receive job counseling. Some 
students (about 15 percent) opt for work study experiences outside the Skills 
Center, where they are required^to work three hours daily, are paid and 
receive 1. 5 units of credit. Still other students receive credit for outside 
work under the extended classroom program, where a student's outside job 
is approved as an accredited learning experience. Advanced training is 
offered in certain areas with^ outside institutions such as the General Motors 
Training Center and the Hyster Corporation Fork Lift Training Program. 

Learning Resources 

Learning resources include the well-equipped shops and classrooms at the 
Skills Center, instructors with career backgrounds in the area in which they 
teach, a counseling and placement office, the libraries and other learning 
resources of the home high schools, and the employer sites for those 
students participating in the work experience programs and other outside 
training programs. 

Student Size and Selection Procedures 

Therp. are approximately 800 students in the Skills Center program. The 
program is open to juniors and seniors primarily from Clackamas, Milwaukie 
and Eex Putnam High Schools, Students from other high schools may also 
attend, at no additional cost, provided they reside within the North Clackamas 
School District. 

Evaluation of Student> Progress 

Students are evaluated by the cluster instructors on the work they perform- 
Students in the work e;qDerience program are also evaluated by the work 
supervisors. 
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The Cooperative Work Experience Program 
at Tigard Senior ffigh School 



A brochure describing the Cooperative Work Experience (CWE) program 
describes it as "a partnership of the business community and students at 
Tigard HighJ' It is essentially a work-release program-Tthat is, students 
work for an employer part-time while still attending school for part of the 
day: The employment of students is specifically within the occupations for 
which the courses in school are preparing them, and the employment serves 
the function of a practical laboratory for 'reinforcir<g the in-school occupational 
education. Students receive both pay and school credit for their work. 

Student Selection * 

A student may enter the CWE program through foUr general interest areas: 
marketing, steno-secretarial, accounting, or diversified occupations. About , 
one-half of the students are enrolled in the diversified cx;cupations class.. 
Students are cho.sen on the basis of their needs, aptitudes and interest in an 
occupational area that is currently available in the community. A total of 
about 27 students from Tigard High School's Marketing,- Steno-Secretarial 
and Accounting programs elect this option. All of those students enrolled 
in the diversified^ occupations class (about "23 to 25 students) are placed in 
occupational areas ranging from industrial mechanics and service station 
work to food service and health occupations. There are thus about 50 students 
enrolled in the program, at any.given point in the school year. The diversified 
occupation's class is. composed of students who are less academically motivated 
than those in the other three cluster programs. 

Structure of the Program 

CWE is designed as a vocational education prograin, eligible fdr federal 
vocational funds. (One-half of the coordinators' salary and the cost of some, 
reference materials are reimbursed through the state department of 
education. ) It is expected that 'students in the program work an average of 
' 15 hours per y/eek in afternoons, evenings, Saturdays or Sundays. Minimum 
wage and hour.requirementS inust be met. The students receive on-the-job 
instruction by their employers and related classroom instruction by the 
program coordinator, and are expected to assume the responsibilities of a 
full-time employee. 

The employer who accepts a work experience student assumes a definite 
responsibility toward the student and toward the CWE program. These 
responsibilities, set forth in a training' agreement with the employer, include: 

1, Supervising the students work on the job. This supervision may be 

assigned to an employee who will serve to oversee the student's work. 



2. Providing necessary training on the job. 
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3. Providing the student with opportunities to learn a variety of tasks 
related to his primary employment. 

4. Evaluating the student's work. This evaluation is made on a systematic 
basis with a rating sheet. It is intended that students' weak points will 
be strengthened and his successes reinforced by discussion on the job 
as well as at school. 

The school assumes the major responsibility for coordinating the activities 
of the program. A designated school coordinator is responsible for finding 
and/or approving work stations, drawing up the training agreement, selecting 
students, working with the- student and his employer, supervision of students' 
in-school academic studies and preparation for job training, and evaluation of 
student pei:formance both on the job and at school. The coordiiiator is- also 
responsible for maintaining proper records for local, state and federal 
requirements and fop implementing the recommendations of advisory 
committees. 

The community shares in the educational activity of CWE through an active 
steering committee which advises the school as to community needs, 
publicity, curriculum, work stations and otKfer instructionar needs. Future 
plans call for forming a separate steeriiig committee for each separate career 
cluster involved in the CWE program. 
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Appendix P 



INTERPRETATION OF EVALUATION FINDINGS 
BY (CE)2 STAFF 



Introduction 

Because the (CE)2 operations staff has had direct experience in working with 
the students and have a different perspective on the program than the NWREL 
evaluation team, the operations staff was invited to read the evaluation 
findings and to write up an independent interpretation of the findings. The 
remainder of this appendix, then, is the interpretation by the (eE)2 operations 
staff. 

Interpretation of Findings by (CE)o Staff 

The (CE)2 staff have reviewed the EBCE FY 74 Final Evaluation Report. We 
find the report meaningful because of the wide range of data collected. In 
many cases evaluation results have alerted the staff to areas needing attention 
from either a design or operational standpoint. In most cases the data hav'e 
substantiated the (CE)2 staff's perc^tion of the program; It is comforting 
to the (CE)2 staff to have this amount of information available and to have it 
presented with such competence and clarity. 

Given, the above reactions io_the jcjeipjDri,_^^^ are still concerned and 

frustrated by the need to gather and display data on an individual bas;s. 
While much of the data gathered on a group basis is encouraging and indicates 
the positive effect of the (CE)2 program on the entire group of students, the 
(CE)2 staff tend to find the growth or lack of growth demonstrated by each 
individual student as the area of their greatest concern. While there is 
always a need to display infommtion on a group basis, the true essence of 
the program can best be observed when the significant' growth of th|B individual 
is reviewed. It is important to know the amount of growth in the Basic 
Skills each student has made, the way in which each individual student is 
using his/her time, the reactions that students as individuals have to program 
procedures such as accountability, and significant changes that have taken 
place" not only in students' competence but in their value systems as well. 
We challenge tlie readers of this report to look deeply into the data presented 
and to analyze individual responses from students, employers, parents and, 
staff. The impact of an individualized program such as this can best be 
discerned by a careful perusal of individual student responses and outcomes. 

1, We are gratified that (CE)2 students have shown signifi^cant growth in the 
Basic Skills area, since, the Basic Skills component of the curriculum 
is of high im'portance to employers, parents and staff, as well as to 
students. However, we have not been satisfied that the Basic Skills 
delivery system has operated as effectively as it might, and therefore 
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intense and significant design changes liave" occurred since the writing of 
this report. Comparison of the (CE)2 growth mth a random sample of 
students at Tigard High School is not entirely accurate since the two 
groups are not comparable in 'skill, interests, or in the e^qaeriences - • 
which they have had in common this past year. 

Changes in attitude as indicated on the Semantic Differential are 
extremelyr significant. It is the feeling of -the staff that the reader should 
balance the fact that students made no growth during the second, half of 
the year with the fact that significant growth was shown for the first 
half of the year. This higher plateau of growth was maintained in most 
cases, resulting in a sizable net gain over the year for all (CE)2 
students^ 

The staff continues to be intensely interested in the students' reaction 
to the .issue of "work." We have tried to create in (CE)2 a transitional 
experience for students between the role of learner and the role of 
earner. As a result, w« do not believe that students are having a 
final and conclusive e:!q)erience with work/s a condition. They will 
only do that when they finally become employed for an established salary 
on a regular basis. We are, however, attempting to expose them to 
and have them e:q)erience a variety of work envi.ronments with all of 
their inherent positive and negative experiences so that students will have 
more adequate data with which to make long-term decisions. 

Experience-with other alternative individualized programs leads the staff 
to expect that students, coming from a more tightly structured school 
environment to one offering. more and different alternative choices, would 
go through a period of self-indulgence. This is especially true In the 
-area of attendance where students are asked basically to, account for 
their own time and establish their own schedules without an adult 
supervising their location most of the program day. The fact that the 
students' attendance at (CE)2 was- slightly improved over their previous 
year at Tigard High School was a pleasant surprise. 

We feel intense frustration that student performance, in the Life Skills 
areas is reported through the number of projects completed. While 
volume of work as it relates to the expectation of students individually 
is important and is monitored constantly, the "quality of the work within 
the /learning projects has to be the only significant measure of student 
growth in this area. While the percentage estimates of learning manager 
evaluations alleviate this problem somewhat, the interested reader is 
encouraged to look deeply within students' projects for an assessment 
of the individual's performance. 

The staff feel that the information regarding the competencies is 
misleading, since students coming into the program for one year only 
were required to complete only seven of the thirteen competencies. The 
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data as presented not give a picture of the student's willingness to 
complete the competencies; they only sugges^^ that when given a choice 
the student fiixJs some competencies more P9pular than others, r The 
average number of competencies completed is a gross measure and 
does not give the reader a definitive view of student performance in 
this area. 

7. It is interesting to note that while student, staff, parent and employer - 
reactions to the effectiveness of the program in apcomplishing fifteen 
student learning outcomes were all positive as reported in the summary, 
groups who were most positive were the students and parents. All Qf 
the parties sampled are important, but the staff consider the students 
and parents as the target groups. 

8. We do concur with the results that many students fell behind in the 
amount of work they were willing to complete as compared to the staffs 
expectations of them. However, if an adequate profile could be drawn 
for each student previous to his/her entry into (CE)2» we believe we 
would find that many students who fell behind in^the amount of work 
completed at (CE)2 were also behind in the regular high school program, 
and in fact were hardly doing any work at all. If this proves to be so, 
it suggests the feasibility of inviting students into the program at an 
earlier age and having them in the program for a longer period of time 
to allow the program to influence more profoundly students' organizational 
and work skills and motivation. While changes in design will no doubt ^ 
have a significant effect on this problem, 'the question, has to be asked 
about the appropriate level of responfdbility the program -sjiiould assume 
for each individual student's performance. . The ideal meeting between 
the student's need to develop independence and self-direction and the 
program's willingness to assume responsibility for the student's behavior 
must be found. A program attempting to encourage self-direction and 
independence cannot become so structured that it fosters dependence. 

9. The summary statement regarding the need for a better structure or 
organization seems to be misleading. At one point a nxmiber of 
employers have sSid that (CE)2's greatest strength is its personnel 
and organization. On the^ same instrument some also said that one of 
the greatest weaknesses was problems in organization. Yet in twenty-five 
families surveyed, only three parents suggested organizational matters 

as a problem. Even in the area of discipline, where it is traditional 
for. parents to disagree with staff and students, only five parent 
respondents e?q)ressed concern. 

In general we feel the evaluation team has done a fair and careful study of 
the program. They have, in several instances, made an effort to transcend 
the limitations of test instruments and statistical reporting to deal adefluately 
with such a program as (CE)2. . 

Last year was good, but wait till you see this year. Baby. 
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HANDBOOK DESCRIPTIONS 



Each handljook listed below will be user-oriented, specifying steps for planning, 
•implementing and operating particular aspects of an E3GE program. The materials will 
be supplemented withi background information, examples of (CE)2 experiences and 
descriptions of alternative methods, when available. 
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1. CTOGRAM OVERVIEW 

2. MANAGEMENT AND ORGANIZATION 
Policymaking 

Personnel 

Comiirunlty Relations 
Biislness Management 

3. CURRICULUM AND INSTRUCTION 
Curriculum Components 
Learning Strategies 

Leajmlng Resources 

ehployer/communiit resources ' 

Employer Recruitment and Selection 



Employer Orientation and 
Development 

Employ er/C ommunl ty Utilization and 
Maintenance 



preeents an overall picture of EBGE and of 
CCE)2 



covers overall program planning and the 
decision making aspects of planning, 
implementing and operating an EBGE program 

delineates staff and staff roles necessary 
for planning, implementing and operating an 
JSBGE program 

concerns internal and external relations 
among staff, board, students,^ parents, 
cnrployers and employees, the educational 
community and the comm\inlty-at-large 

covers such operational considerations as 
budgets, financial reports, office routines, 
insurance, health and safety provisions, 
facilities and transportation 



describes curriculum content areas 

concerns the strategies and planning and^ 
monitoring activities necessary to deliver 
student learning 

deals wlih individuals, sites, materials and 
jeNiulpment supportive of student learning 



describes procedures for Involving employers 
in the EBCE program 

describes gatherings for orienting and 
•*t3:aining". employers 

concerns the use of employer and community 
sites-, personnel and resources to deliver 
student learning * '^^O 



STUDENT- SERVIGB5 

Becrultment , Selection and 
Orientation 

Guidance 



Student Information System 
Hecords and R^orts 

Credentialing 



details -Uie process of getting students into 
the program 

covers those student services that coordinate 
and support individual student growth 



expljadns the process of collecting, recording, 
interpreting and reporting infolmatlon on 
student progress throu^ the EBGE program 

concerns the process of providing records of 
student performance to •facilitate exit or 
gradxiation from the program 
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